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ABSTRACT • 

** This booklet describes the goals and organisation of 

many early childhbod Title I (ECT-I) parent programs and suggests' 
evaluation methods. The informatiqn is intended' for program planners, 
evaluation personnel, ^nd teachers. Only activities that invqlve 
parents ^in the education of theiK child so as to improve his academic 
competence ate discussed. Thje metlrodi^f parent education 5 are 
difficult to define. Many parents mrynave access to successful child 
rearing information, but are unable to implement these ideas. There 
is also no evidence of a causal relationship between' specific 
pairental and child behavior. Most -programs of parent participation 
provide joiat activities to develop a child's language and cognitive 
skifiLs. Other programs emphasize the process of learning as more 
important than the^ont^nt. These programs encpurage parents* to allow 
exploration in a safre and stimulating environment. A multi-faceted, 
evaluation strategy is necessary which is matched to the program. 
Evaluation shorild focus on the program, not the parents. Instruments 
should be short, simple, and readily analyzed to yield information 
useful for' program improvement. Parents should be involved in / 
planning, implementing and evaluating their $wn programs. (DWH) 
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• FOREWORD . ~ 

This booklet has been prepared ^part of^ a project sponsored by the 
United States Education department (USED) on evaluation in early childhood 
Title I (ECT-I) programs. It is one of a series of resource books developed 
in response to concerns expressed by state and local personnel^ about early 
childhood Title I programs. The series describes an array of diverse 
evaluation activities and outlines how each of these might contribute to 
improving local programs. The series revolves around a set of questions: 

• Who will use the evaluation 0 results? 

, • What kinds of information are users likely to find most helpful? 

• In what ways might this information ai£ in program improvement? 

• Are the* potential benefits substantial enough to < jixsjfc-ify the cost 
^nd effort of evaluation? , * ' 

Together? the resource books address a range of issues relev^t* to the 

evaluation of early childhood programs for educationally disadvantaged 

children. The series comprises the following volumes: 

• Evaluating Title I Early Childhood Programs:. An Overview 

• Assessment in Early Childhood Education r • ; 

• .Short-Term Impact Evaluation of Early. Childhood Title I Programs 

. / • 

• An Introduction to the Value-Added Model and Its Use in Short-Term 
Impact Assessment - L* '> 

' « * . ' v 

• Evaluation Approaches: A Focus. on Improving Early Childhood Title 

I Programs • . 

• Longitudinal Evaluatsioj* Systems for 'Early Childhood Title I Programs 

• Evaluating Title I Parent Education Programs 

The development of this series follows extensive field-work on ECT-I 
programs (Yurchak % Bryk, 1979). in the course'of that research, we . 
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identified a number of concerns that SEA and LEA officials had abodt ECT-I 
programs, and the kinds of information that might be helpful in addressing' 
them. Each resource book in the series thus deals with a specific concern ♦ 
or set of concerns. The books and the evaluation approaches they T describe \ 

do not,, however, constitute a comprehensive evaluation system to be uniformly 

• • ' ' ' • 1 

applied by all.. Our feasibility .analysis (Bryk; Apling, & Mathews, 1978) , 

indicated that such a systenj £ould~not efficiently respond to the specific 
issues of interest in any single district at any given time. Rather, LEA 
personnel might wish' to dr&w upon one or more of the approaches we describe, 
tailoring their .effort ^ to fit the particular problem confronting them. 

Finally, the resource books are not comprehensive technical manuals. 
Their purpose is tc\heftp local school personnel identify issues that might ^ 
merit further examination and to guide the choice of suitable evaluation 
strategies to address those issues. Additional information and assistance ^ 
# in using the Various evaluation strategies are^available in the more techni- 
cal publications cited at the end of eacrh volume, and from the Technical 
Assistance Centers in the ten national regions. . 
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I.. v^NXRODUCTION- 

. * This resource book briefly discusses the. issues and challenges of evalu- 
ating Title I programs for "the parents of young children. It describes the 
goals -and organization of many early childhood Title I (ECT-I) 'parent programs 
and bresents various ways of evaluating them. The booklet is intended' for 

' \ I *v 

program planners, evaluation personnel, and teachers. Some of those persons 
will already know something of Title I evaluation but may not be familiar with m 
t*fce special issues of" evaluating parent programs. Others njay be knowledgeable 
about programs f or, parents but unaware of ways in which evaluation c^n be used* 
tb improve what they are doing, . 

The bo'ok is 'organized into six* chapters. Chapter II explains the ration- £ 
- ale* for programs for the parents of young chiFdren and describes severaj types 

'of program currently funded under Title I. In Chapter III we discuss evalua- 
tion plans: why evaluation might be done and .what^decisiofis it might inform. 
We also exaMne tissues of technical quality -and point out why expectations 
for evaluations of programs for parents must be more modest than those for 
evaluation of other types of program. In Chapter IV we discuss meeting in- • 

'dividual needs and assessing individual , growth of parents,* and Chapter V - 



presents some techniques for gathering descriptive information about programs 
and for evaluating their effectiveness. In the last chapter summarize 
some'of the challenging issues^ involved in evaluating programs for-parents. 

♦ 

Finally, we provide'ref erences to sources of further information on the 

> \ 

topics treated in this resource book. 

» • - ; : 

^ A few general comments are in order. First, we treat here only those 
activities that involve parents in the education of their child so as to 

'. * ' * 

improve that child's academic competence. "More comprehensive activities--' 
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for example, job trailing or personal counseling, such as in the Follow 
Through supplementary training component of the Child and Family Resource- 
Program — are often an important part of parent involvement; however, as they 
are beyond the scope of programs currently al^fbwed by Title I, they are 
omitted from our discussion. • < 

Second, this book — like all the resource books in the series — stresses 
the usefulness of evaluation to LEA decision making, knd particularly for 
purposes of program management and improvement. If the evaluation of pro- 
grams for parents can reduce uncertainties and help decision makers v in their 
tasks, it is well worth pursuing. v If it cannot, it might better be left 
undone. ' 

Finally, experts agree tha-t for reasons both methodological and ethical, 
evaluating programs for parents presents special challenges. In our^survey 
of parent programs, we sought information on evaluation techniques from many 
"Sources. First we consulted academicians and practitioners particularly 
knowledgeable in the area of parent education. Then we examined the useful- 
ness to ECT-I parent progiams .of the tests of mother-child interaction cited 

4 

in the Test Collection of the Educational Testing Service. We also conducted 
an ERIC search for parent education programs. Ke sent 300 letters of inquiry 
to all programs identified tlffere, to programs listed in Education Programs 
That Work (United States Office of Education, 1978) that include parent com- 
ponents, and to programs included in the Interim Handicapped Children's Early 
Education T Program (HCEEP) Overview and Directory , developed by the BEH (1978). 
We received over 100 replies covering a \^ide range of programs. Most of , 
these described their parent involvement component, but few specifically 
discussed the meawS of evaluating it. Some said they simply did ntft know 
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how to evaluate p-rograjns for parents. Almost all concurred that the task 
is particularly difficult. Specifically, many* expressed frustration ovpr 
the follpwing:' - • * 

• The technical quality of available assessment measures 

• The difficulty of matching measures*to their program or population,, 



• The inability to allow for the particular aptitude-environment- 
treatment interactions between each parent and 1 the program' 

• Reluctance to intrude on family privacy. 

In spite of these sobering realities, most program personnel remain 
committed to and enthusiastic about programs for patents and believe in the 
efficacy of their own programs. Moreover, th6y demonstrate ingenuity and 
resourcefulness, in designing ways to waluate and then improve them. It is 
our hope that this book can transmit their ideas and so help resolve the 
evaluation dilemmas facing other programs for parents. - * • " 
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II.. TITLE I PROGRAMS FOR PARENTS OF YOUNG CHILDREN 

t ' 

One clear -trend in early childhood education since the 1960s has been 
increased emphasis on parent involvement (Haney, et al., 1980;'Datta, 1975). 
Title I of the Elementary and Secondary Education Act (ESEA) of 1956 (as 

r ■ • * . \ 

amended) has. greatly influenced that trend. In this chapter we briefly f^e- 
view the history, of program^ for parents > the types of programs that have 
evolved, and the specific^ provisions of Title I that determine the nature of 
parent programs under its aegis. Then we consider the implications of various 
approaches to program evaluation. 

RATIONALE FOR PROGRAMS FOR PARENTS OF YOUNG CHILDREN • 

Education programs for parents are not new. Over the years various 
programs have aimed at helping parents promote their. children's moral develop- 
ment, emotional and social growth, physical and mental well-being, cognitive / 
development, and academic achievement.. Most recent efforts have concentrated 
on enhancing cognitive skill and academic achievement, particularly among „ 
children of poor families. These activities have come about for three reasons. 
Eirst, When preliminary evidence suggested that compensatory preschool educa-, 
tion programs alone brought no sustained improvement in children's intellect 
or academic performance, program, planners sought more effective means of in- 
tervention for educationally deprived children than the simple notion of a 
year of prekindergarten. Second, new research findings pointed to the im- 
portance of the early years of life in stimulating children's curiosity, pro- 
pensity.to explore, and later cognitive functioning. They also suggested 
that since the role of parents in early child development is crucial, programs 
starting during the first yelrs of a child's life might be more effective if 
'they had intensive parental participation. Finally, increased public demand 
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that education programs b,e made accountable to the community, led to provisions 



not only guaranteeing parental rights to- plan, review, and evaluate programs, 

i - 

but, in theory at least, establishing a partnership between parents' and schools 

f > . r . * 

to insure the best educational opportunity for children. 

* 4 " , • ' 

Taken together, these ideas generated a variet^of /programs for parents^ 
of young children. Such programs are built on the supposition that parents, ' 
even more than teachers, can respond appropriately to their chiTdtfen and pro- 
vide an early ,and continuing. environment of stimulation, security, and affec- 
tion. If some parents fail to provide the necessary support, it ^ not through 
intent, but because they do not know how. These parents can be taught the 
rudiments /of child development and guided to activities and ways of inter- 
acting that will % help their children ' learn. Education programs caji provide 
parents with opportunities to practice new skills. Moreover , 'once the parents 
have been adequately instructed, their new knowledge will carry over to other 
children in the family, and the family environment will become richer, more 
stimulating, and more appropriate to the development of all its children. 

However, there is *no clear order of importance in the various findings i 
about the way children learn. Nor has- it been shown that there is a singl-e 
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best way for parents and children to interact or for parents^to take part 
in their child 1 s veducation. Therefore, there has been a proliferation of' 
programs, differently organized and with different goals, reflecting dif- • 
ferent notions on the best way to involve parents. IVe have identified four 
models: the indirect information -model , the direct instruction .model , the 
resource volunteer model, and a model ^involving parents as poli-cy makers. 
The indirect information model uses program staff to infopn the parents* 
about the program and the child 1 s progress. Conferences, report cards, 
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general meetings, and information bulletins areconmon ways to do this. The 
basic assumption iti programs like this is- that^carents serve best as rein- 
forcers of school learning. The more they know aboyt their child's school 
.program the more they can--and wilL--siq?port it at home. * The second model, 
direct instruction,' teaches parents how to instruct their children, although 
there is some d4§agreement on how this is best cone, These parent education 
or parent training programs have been variously designed to help parents 
understand child development in general*, to take account of their own chil- 
dren's characteristics, to develop specific skills in instruction or inter- 
action, and to provide an "optimal match' 1 between children's ne^is-s^nd 'their 
education. In these programs parents are both students and teachers, ajid 
must both learn what to do and transmit that knowledge eff ectively-to their 

children.. t 

A third type of parent program ^relies on parent participation in volun- 
teer or support activities. Program staff define parents' opportunities-- 
or responsibilities — for support, including such things a$ serving as volun- 
teer aWk % s, accompanying the class on trips, raising funds for program use, 
and participating in school clean^j^^r construction activitTes. Through 
parents'* association with school activities, proponents' of these programs 
hope to promote favorable attitudes toward the program that will indirectly 
lead to a supportive attitude at home and to improved' school performance. 

Finally, many jjrogr^ have tried to involve parents as advisors or 
policy makers. Through advisory boards or councils, parents may participate 
in planning program modifications and in needs assessment or evaluation, or 
act as advocates for the program within the community or in ajarger political 
arena. ' . 
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TITLE I PARENT PROGRAMS ' % ' 

Let, us now review the provisions of^Title I of the Elementary and Secondary 
Education Act that relate to parent involvement and examine how they are applied 
in ECT-I programs.' Both the provisions themselves and the ways in which they 
are applied have important implications for program evaluation. » 

Title I requires that Local Educational AgenciW (LEAs) involve parents 
in two ways: (1) in governance and policy making, and (2) in education programs 
The former takes' place through Parent Advisory Councils (PACsl, and these are' 
subject to a number of regulations. Title I legislation and rules % are more 
open about the latter, allowing considerable latitude for local decisions about 
the purpose, content, and organization of parent participation in education 
programs . m 
Parent Advisory Councils 

Parents participate in Title I program governance and policy making via 
Parent Advisory Councils. Composition of and eligibility for PACs is clearly 
specified. Section 125 states that an LEA may receive funds under this title 
only if it establishes a Parent Advisory Council for its .entire school district 
and for each project area or ,pi^Qt school.* PAC members must be elected 
by the parents of children to be served by projects assisted by Title I. 
The district PAC must also include representatives of children in schools 
eligible rfor but not participating in Title I programs. For project are^s 
or project 'schools in which 75 or more children are served, there are ad- 
ditional requirements as tp the size of the PAC, membership, responsibility 
for electing officers, and frequency of meetings [Sec. 125 (a)]. 



An exception is made in cases where not more than one full-time equivalent 
staff member is paid with Title I funds, and where not more than 40 
students participate in the program [Sec. 125 (a) (B)] . 



the tasks of PACs are more generally stated than is their organization. 
Thus Section 125 requires that: 

* • \ 
Each local education agency shall give each advisoxy council 
which it establishes under subsection U) responsibility for 
advising it in planning for,' and implementation and evaluation • 
of, its programs and projects assisted tinder this t:itle. 

How these tasks are carried out is determined within local education 

it 

"** * 

agencies'. 

>In ordfir to assist PACs with their responsibilities, LEAs must provide 

each PAC member with: the, text of Title I; all federal regulations and guide 

lilies Issued under or associated with it; all appropriate lobulations and 

guidelines associated with the' title; and/any report result-ing-from state 

or federal auditing, monitoring, or evaluation in the district [Sec. 125 (c)] 

To enable PACs to use that information and to function knowledgeably , LEAs 

must provide a training program' for parents, but the content of that program 

is not specified. The legislation states only that the program: 

* * (1) shall be planned in full consultation with the members 
of such advisory councils; '. \ 

. ^, 

(2) shall provide each meii^er^of such councils with appr- 
opriate materials; and 

« (3) may permit the use of funds under this title for ex- 
penses associated wittr-SuCh training, including expenses 
' t associated with the* attendance of such members at draining 
sessions . • 

[Sec. 125 (cl) (b)] 

c 

How parents are trained is thus a local metter. »\ 
Participation in Program Activities 

Two sections of Title* I describe parental participation in education 
programs. Section 124 (1) states: 

A. Local education agencies may receive funds under this 
title only if parents of children participating in programs 
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assisted under this 'section are permitted to participate 
in^the establishment of such programs and are informed 
of and permitted to make recommendations with respect 
to the instructional goals of such programs and the prog- 
ress of the children in such programs, and such parents 
are afforded opportunities to assist their children in 
achieving such goals. 

Section 117 (cV provides for access to information parents need: 

E. Each local education agency which applies for or re- 
ceives funds under this J^Ltle shall make the application 
^'^fidjall pertinent -documents' related thereto available to 
- parents, teachers and other members of the general- public . 

However, Tit4^ I does not spell out how information is to *be nade available 
pr how parents are to take part in establishing programs, making recommenda- 
tions about urogram goals, evaluating their children's progress', and helping 
their childi/en to achieve goals. As a result, LEAs interpret the' provisions 
in varioys //ays, and parent involvement in Title I takes on all of the aspects 

we have described: information sharing, parent education, volunteer worlT, 

/ • 
and governance. Programs reflect local needs and Resources as well as local 

administrative capabilities. Moreover, in general, programs for parents 

change, as' the children grow plde*. For the parents of young children, pajrent 

education actitivies tend to be projects, while programs for parents of 

older children are often subsumed under the more general activities of PACs. 

IMPLICATIONS FOR EVALUATION ' . 

t 

Because programs for- parents are so diverse, they will differ in their 
effects on both parents and children. Therefore, any attempt to evaluate 
^ .program will have to take careful account of its goals. What was done 
and how well can be judged only .against the backdrop of what was intended. 

There are many ways^of organizing the goals of Title 'I parent programs. 
One simply way is to consider them in two broad classes: those directed at 
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changing parent^ 1 knowledge, attitudes, and behavior with respect to their 

children's learning; and those designed to change parents'- knowledge, atti- 
v 

tudes, and behavior toward school services' and personnel.* Figure 1 surama- 
rizes the two goal areas and gives examples of typical objectives in eachw 

Parent education programs concerned with fostering knowledge about child 
development and the' learning tasks of young children^CCell A) might instruct 
parents on topics such as how to understand age-appropfT^pfe child behavior, 
or teaching techniques. A reasonable subject for instruction would be reading 
readiness. Program personnel might describe to parents the various Skills 
involved, such-as letter recognition, auditory sequencing, and visual scanning; 
suggest ways to motivate the child to leayn; and finally, provide reading 
readiness activities or perhaps easy reading materials. 

Programs focusing on parental attitudes toward children's learning 
(Cell B) would help parents to Recognize their child's characteristics and 
to develop appropriate expectations of the child. They night try to make 
parents aware of their attitudes and beliefs about their child, perhaps by 
role playing or by vTdeortaping simulated parent-child interactions. In 
these programs, parents are encouraged to believe that the way they interact 
with their children makes a difference to their s childr en's learning. They x 
^re helped to feel more comfortable and secure in their roles as home teacher? 
of their children. At the same time, the importaace of being readily acces-. 
sible to their children and of co^eying interest and approval may be stressed. 



* There are also programs with goals that go beyond the parental role and 
try to meet the personal needs of parents as adults. \ Since these are 
beyond the scope of activities allowed under Title I, we exclude thera 

<v from this discussion. 
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Goal : 
To Produce 
-Change in 



Parents 1 
Knowledge 



Parents 1 
Attitudes 




Focus 



To understand th^ child. 1 s educa- 
tional, emotional, and health (in- 
cluding nutritional and dental) 
needs 

To know what play material is 
appropriate at different ages 

To know what the child should be 
learning and how best to help 
him learn 



B 

To appreciate the child's in- 
dividual characteristics of tem- 
perament and learning 

To develop realistic and flexible 
expectations of tfrfc child 



Toward School 



D 

To be aware of services available 
and how-to use them", e.g., referral 
for special education 

To know what tasks the child is 
working on in school 

Tofbe aware of the provisions of 
Title I and the federal regulations 
and guidelines associated with it 

To understand and use program 
evaluation reports in planning 
program activities 



To trust school personnel and j 
view themselves as partners of ^ 
the schools in the evaluation 
process 

To view themselves as important in 
the success of their child's educa- 
tion 



Parents ' 
Behpfior 



To, adapt behavior--such as verbal 
behavior and patterns of respon- 
siveness, availability, and sup- 
portiveness--in ways that will 
promote the child's growth and 
development 

To provide appropriate instruction 
in school readiness activities - 



To seek appropriate services, e.g. : 
.referral for special education 

To initiate and attend conferences 
with teachers as appropriate 

To participate in PAC Meetings and 
other planning, , implementation, 
and evaluation activities 

To help other parents become in- 
volved in Title I activities 
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Figure 1 : Examples of Goals for Parent Involvere-nt 
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Finally, parents are helped to provide material, and experiences that are in- 
teresting and , challenging to their child at each stage of development. 

Parent education programs in which the main goal is to change the way 
parents teach their children (Cell C) usually provide more directive activities. 
They show parents' how their actions--how they speak and respond to their chil- 
dren, and hdw supportive they are— affect , the child. Parents night also be 
shown how to use appropriate rewards to reinforce achievement. In addition, 
the.se programs instruct parents how to teach their children school readiness 
•skills--for example, by demonstrating how to use simple letter games to help 
their children "with letter recognition. 

Turning now to programs that fozds on parental knowledge, attitudes, 
and behavior with respect to schools and the educational process, we see 
activities of a somewhat different sort. Cell D illustrates the first of 
these. Many parents, especially those who come from poverty, have had bad 
experiences with public institutions, including the schools. Their perception 
of education and schools is colored by feelings and values' that sometimes 
preclude effective collaboration. Often the most needy parents a*re also 
the most reluctant to deal directly with school personnel, either about 
their child's education ofr about more general program issues. The goals of 
•many parent education 'programs therefore include breaking through this re- 
serve by giving parents full, easily understood information* about the program: 
what it offers, especially as it relalj^rx^ their child; how to rea^ch the 
services and personnel .that will kelp; how effective the program has been; 
other programs and services; and how to initiate changes that seem desirable. 
/ - At the same time, program personnel may seize the # opportunity to acquaint 

3 \ 

K interested parents with the .provisions of Title I and the associated 
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regulations and guidelines. They may also tell them abput the program evalu- 

ati"bn reports and perhaps involve them in evaluation activities., 

' * ' 

- Closely related to these are the goals that fall in Cell E, Jteny projects 

now strive to change parental attitudes toward the schools. * They aslc parents ' 

•to become active advocates, not, only for their own children but in planning 

optimal Title I program activities for all eligible children. They try to 

develop trust between parents and school personnel, a sense of being partners 

working together in the best interests of all children. They *encourage*parents 
■* » • 

to .view themselves as important to the success^of their child's education. 
Finally, in Cell F wl have changes in the wa>^ parents' relate to the 
school 2nd the education process. Seeking parent involvement in order to 

assure program accountability appears in this domain. Examples of other ob- 

> 

jectives are: to have parents attend parent- teacher conferences with appro- 
priate frequency; to request special services when necessary; to participate 
in PAC activities, and attend PAC meetings. 

In practice, of course, programs h&ve many goals. While evaluation need 
not deal with all of them, it should be a valid assessment of at least some 
of the significant ones. Each program mustytherefore decide which of its 
goals are the fhost irflportant and hence merit attention in evaluation. A 
variety of techniques are available for obtaining the information needed to ♦ 

9 

evaluate progress toward those goals and to assess other program facets of 
interest, such as the opportunities for parental involvement , parents 1 reac- 
tions to the program and its usefulness, or the short- and long-tern effects 
of the program or\ children's learning. These techniques include unobtrusiye 
measures, parent reports, and rating scales; tests and direct observations, " 
(teacher ratings, home observations, observation of parent-child interaction); 

20 



and self -study and process evaluation. T .\hich of th^se are used depends ^ 

largely.* u Pon the focus oY the evaluation. ' \ 

In the -follbwing, we first describe how, to planjan evaluation. We then 

discuss the Family Education Plan, whici 'guides the formulation of program 

* 

goals and the assessment of program effects on families. Finally, we examine 
the various* techniques available for gathering the inforraati6n needed for 
program evaluation. 4 • 
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III. PLANNING AN EVALUATION • , 

* Sometimes good fortune" and good planning comhirje to permit program 

planners and evaluators te^develop education programs and their evaluations 

concurrently. The former clarify program objectives as tt\e Matter Establish 

the best ways to determine whether those objectives are being met. Moreover, 

beyond assessing the fit "between program aims and .their at«t^intten£-, evalua- 

* . , / ' *\ ' - /* 

tiojn can have an additional function: It can provide information, to help 

with the myriad decisions that must be made about .the programs-ana provide^ 

it at the right time, when it is most likely to be useful for maintiiQ^fe' 

and improving the -program. f * 1 

WHAT DQ YOU WANT TO KNOW? r ' \ , \ / 

The first key issue in planning the evaluation is, why conduct it at 
all: what kinds of decision must be made, and in what ^(Jer? Almost always 

more than one kind of decision is pending ^at the same time, so evaluation 

\ . * 

plans for many programs have more than one component. For example, m one 

A • 1 

Colorado education program for parents of preschool children^"" it was decided 

\ - 
that the most important questipns were: - 

# \Di9 the program deliver the services it promised, as frequently as it 

Vaid it would? - . 

\ ' 

HovX did participating^ parents react to the program? 

• WhatNtes the short-term effect of the program on the children of ' >j£ 
its participants? * m - , 

The Valuation thus had three components. First, records of scheduled home 
visits and meetings showed how often the program enabled parents to partici- 
pate, while attendance figures showed how often individual parents did so, 
which of them used the j^ogram most, which services they us^ most, amount 
of use at various times .of year, and whether frequency of program use was 
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associated with children 1 s achievement. Second, a survey conducted at the 
end of the school year revealed what parents saw as the strengths and weak- * 
nesses of the program and how they thought it had affected them. This sug- 
gested to the program director and teachers where improvement was needed for 

• / ^ , 
the next year. Finally, scores on school readiness tests indicated the 

program's short-term impact. Although there was no formal control .group, 

* » 

the scores of participants ■ children were compared with those of children 
enrolled in the Title I kindergarten whose parents had not participated in 
the parent program, and were found to be significantly higher. 

f 

Other programs for parents might focus evaluation efforts on other 
issues. If, for example, they wish to know about the effectiveness of the 
information about th^ program that they distribute to parents, they might 
ask: f 

r , 

• Do the parents read the reports or newsletters sent home? 

• Do they usie the information? For example, do they know what activ- 
ities their child" 1 s class is concentrating on ftr what tasks the chil- 
dren are learning? Do they know when the next parent meeting will 
take place, and are they planning to attend? 

% • If they % use the information, how do they do so? 

• If they do not, why not? " " 1 
Parent educators might want the answers to other questions : 

• Do parents who participate in parent program^" change their way of 
• teaching or behaving with their children?- 

• Do participating parents use other community services differently? 

• Do the children of parents who participate in their school activities 
have different attitudes toward ^school than children uhose parents 

do not participate? J 

_ * 

• Do they achieve any better? 
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When parent participation consists in volunteer activities, evaluation 
questions might be phrased in terms 6f frequency of participation, amount 
of mbney raised, number of projects completed, frequency of parents' outside 
speaking" engagements, and 'the. like. Finally, governance as the primary 
focus requires a careful examination of the decisions made, how they are 
reached, whether or not they are put into practice, and how competent 
parents feel in the role of advisor, . ^ 

Evaluations can be designed so as to answer all of these and a great 
many other^uestion\. The first challenge is to agree on which decisions 

% 

are the most CTucial, and--since trade-offs are sometimes necessary--which 

* «• 

may 1iave to be deferred, at lea$t for a while. Alternatively, it be 

reasonable to focus on one set of decisions when a program is getti-ng 

started and another when it is firmly established, . In any case, onte evalu- 

ators, program staff, and parents have looked closely at the program goals 

to see what the program purports to do, they must^then list the pQ§sible 

decisions to-be made^and the kind^ of information necessary to make them, 

WHAT ROLE WILL PARENTS PLAY? 9 

— * « 

* A second key issue is the role of parents in the evaluation. The most 
^ obvious, although by no means the only one, is that of objects of evaluation. 
Evaluation a# program staff examine the short-term impact of the program, or 
~ its later effect on parents' knowledge, attitudes, or behavior. Parents 
take tests, fill in questionnaires, or allow themselves or their homes to 
be observed so that program effectiveness may be estimated. 

Ivlul g" this kind of traditional measurement may be valuable for some 
purposes, we' suggest a different technique that many programs enthusiastically 
report: to have parents act as agents of the^evalu^tioxf^instead of — or in 
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addition to—being its objects, MaYiy parent education programs find 'it Use- 
ful and economical to involve parentsat every step-in planning, implementing, 
and evaluating their own programs. Program staff and parents jointly assess, 

. the need for a program, identify goals for the program as a whole and for 
individual parents, determine a useful system of service delivery, and. finally 
document implementation and evaluate the effect of the program. Education 
for parents thus becomes education witfr parents. Some of these tasks, such 
as assisting in program planning and evaluation, are ideal activities for 

-^ACs. Others, such as setting individual goals and assessing individual 
progress, lend themselves better to joint planning by teacher and parent. 
For evaluation purposes, this kind of involvement means that although they 
may need training and support, parents help to decide what information to 
collect, how to analyze it, and how to u£e it. It also probably means that 
data Vfil 1 be easy to collect and analyze. Results should be presented clearly 
and simply, so that ,^hey can be readily translated into appropriate changes 
in individual programs, and later into decisions about the total program. 
WHAT ABOUT A CONTROL OR COMPARISON GROUP? 

A third key decision concerns the standard against which the program 
can be judged. Under ideal circumstances a well-designed experiment is the 
best way to evaluate the effects of a program, because it she^s light on *> 
cause and effect. Unfortunately, experiments are rarely feasible for evalu- 
ating. Title I programs .for parents. The simplest case of a^ conventional 
experiment requires the following steps: 

• Identify the population to be examined (parents of young children 
eligible for Title I assistance) and select a sample from it 

• Use random or some other probabilistic assignment to -divide the 
sample into two homogeneous groups, a treatment group and a control 
group 
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• Ensure that the two groups remain as much alike as possible; except 
for participation of the treatment group in the program 

« At the end of the program, compare the two groups on variables of 
interest. 

i 

For 'a number of reasons, these requirements are difficult to neet in programs 
for parents.* First, it is hard to know* how to define an eligible population 
of parents. Are social and economic variables enough? Eligibility require- 
ments for Title I programs in general decree that they are not. Should 
parental competence be measured in s*ne way? Our later discussion will show 
that this' cahnot be done at all validly. How about children's competence? 
Should parents be identified and then matched by their children's performance 
on one test or another? The predictive validity of young children's per- 
formance on tests is also weak. Second, even 'if eligibility can be agreed 
upon, identifying candidates and then selecting from among them is 'difficult. 
Schools lack jurisdiction over parents, and parents' lives are seldo ra< geared 
t,o school calendars and schedules. 'All schools can do. is n:ake a' program '. 
available. Parents must decide whether they wish to join and can arrange to 
do so, (Haney, 1980). -Third, as we have seen, participation cannot be *** 
randomly arranged. Some parents will be more willing to join the program 
than others. Whatever the reasons for this, participating parents probably 
do not represent ECT-I parents as a whole; therefore the results of an evalu- 
ation can rarely be generalized to parents who do not. part icipa^fe. Moreover, 
randomly assigning some volunteers to the program and others to the control 



* For a more detailed-but easily understood-discussion of^he methodological 
issues of evaluating parent education programs, the reader is referred to - 
Gray, S.'and Wandersman, L., The Method^ogy of Home-Basec Intervention 
Studies, Child Development, 1980, 51_, 993-1009. 



m group is impractical: imagine telling half the parents who want to join 
your program that they can't,, but that you Still would like to collect data 
from them! 

Even if a program group and control group can be set up, difficulties 
almost inevitably arise in, maintaining them. Parents in the program may ' 
decide that they don't like it or don't have the time; and parents in the 
control group, who had little incentive to participate anyway, may not be 
available for later assessment. Thus the group, gfriginally comparable, may 
be quite different when the program ends, which will distort the results. 

Another requirement for experimental integrity is ensuring that the 
control group" does not- receive the program. This is not always easy. For 
example, some of the parents in the two groups may be friends. Those in 
the treatment group will discuss what they have learned with those in the 
'control group. Or parents in the control group may seek out and participate 
in ^comparable program: if they joined from interest in your program, their 
disappointment at being excluded may lead them to tn\t alternative — which 
may also have positive effects. Thus when the two groups are compared, 
little difference will be found. The obvious--but inconrect — conclusion 
is that the program doesn't work. 

We see, then, that the theoretical advantage of experiments and quasi- 
experiments* often disappears when we use them to evaluate ECT-I programs 
'for parents. Instead of obtaining unequivocal information on program effects, 
we may end up confused or misinformed f about the worth of ^he program. There- 
fore, evaluatoys and planners in many programs have turned to less rigorous 



* Wfe have concentrated on the problems of true experiments, but the dif- 
ficulties are similar in quasi-experiments using equivalent control 
groups or time series. 
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but more practical methods that link evaluation to the needs of families or 
to program management and development. In the former, evaluation often con- 
sists in developing an individual Family Education Plan with each family, 
and then joifitly determining whether it was implemented as ffrescribed and 
assessing its effects. In theMatter, evaluation focuses on the program, 
carefully describing what took place and how parents felt about participating 
in it. 




- IV. FAMILY EDUCATION PLANS r \ 

Perhaps the biggest challenge ,to those who develop and run programs for 
parents is to take account of the enormous differences among families. In 
the broadest sense, families differ in the goals that they have for them- 
selves and their children, in the cultural values and "experiences they bring 
to child rearing, in ? their attitudes toward education in the public school 
system, and in their personal style £nd tolerance for particular child be- 
havior. For example, the mother of three preschool children might be ex- 
pected to spend far less time interacting with each child, and to be less 
immediately responsive to each child's overtures, than a mother who has only 
one ftiall child. On the other hand she might time her interactions more 
skillfully or respond more appropriately than a first-time mother. Similarly, 
parents/ whose experience with school personnel has been as subordinates, and 
whose own education has not led to success and fulfillment, might be expected 

\o respond quite differently to teachers and home visitors than parents who 
view education as a means to a better life. Program personnel quite reason- 
ab'ly try to tailor their expectations, their teaching styles, and even the 
content of -programs to each family's needs. One way of doing this is to 
develop a Family Education Plan CKEP) . *- 

^ *The FEP resembles the concept of the Individualized, Education Plan (IEP) 
that LEAs must develop for all'^andicapped children under^PL 94-142 (tHe 
Education for All 'Handicapped Act)** While the process of devising IEPs t 
'varies somewhat from program to program, the steps that are -standard and . 
that directly apply to developing FEPs are these* jointly assess individual 
needs and determine goals; decide how to meet these needs; implement the 



* The Authors are indebted to Chris tine-Dwyer of the Title I Technical 
Assistance Centex in Region I for her helpful suggestion in expanding 
and refining the concept of the FEP. 
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decisiqn; see how well the needs are being met; modify program goals and 
adapt procedures. Assessment their becomes a measure of individual progress 
as well as a planning step for the next phase of the program. 

There are several ways to go about determining individual parental 
needs. One is a questionnaire such as that illustrated in u Figure\2. This 
is useful in first defining the ^reas in which parents want heip ahd later 
showing, how the parents feel the program responded -and how myeh the)t have 
learned. In the questionnaire shown, the range of topics" is broad; other 
programs may offer a more modest choice, and a much simplei^fibestionnaire 
might be developed to reflect that range. Note that the questionnaire clearly 
implies that certain parental needs can be met; it is therefore very important 
that the program actually; be capable of meeting them. Unrealistic promises 
lead to thwarted expectations and feelings of failure all around. 

The next step in determining the needs of parents is for staff to confer 
with parents at the outset of the program, A few questions about their child, 
themselves, and how they wish to participate in £he program should lead to 

^initial /jjoals and a tentative FEP. As parents and program personnel continue 
to- work together, more specific behavioral goals and a more detailed FEP may 
be'developed and periodically reviewed. An example of the way the process 
works is the following. A parent may initially wi^h to help make the child 
ready for school. The parent may need to know more about this--what skills 
the child should have, and how to teach them. Together, parent &nd program 

.staff may decide that the- child should learn to enjoy storybooks and khow N 

how to look at the details of the pictures. They may determine that the 

I 

parent will get a library card and read the child one short story eachr day. 
At an agreed time several- weeks into the program, they may review whether 
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the library card has been obtained; and a liA of the books signed out and 
read will indicate how well the parent is moving toward -the kgreed objective. 
Critics of the IEP process in special education =^on tend that developing > 



these plans for children is time-consuming and expensive. Federal regulations 

1 

f<V the educational handicapped children (PL 94-142) and sometimes state 

counterparts require that parents, teachers, and other specialists, (e.g., 

school jfrincipals , guidance counselors) meet several times to assess family 

need and determine educational objectives. . Proponents of the process argue . 

t 

equally vigorously that IEPs provide the most directly relevant instruction 
for each child and generate evaluation information useful at both individual 
and program level. Moreover, they maintain that FEP procedures need not be 
as complex. For example, there is no reason why the same classroom multi- 
disciplinary procedures need be followed for FEP. ' Unlike programs for handi- 
capped children, developing programs fpr parents includes relatively Utile 
in the way of formal diagnostic evaluation. Hence the potential cast of, 
characters is 'considerably reduced. Moreover the number of staff available 
to work with parents is likely to be limited and it seems superfluous to 
'involve staff members who will hot participate in the FEP. A small group 
Vf potential service providers is perfectly adequate, particularly if one 
member is identified as a liaison or advocate for the family ana assumes 
responsibility for implementing the FEB. Finally, like the lEP process, 
the FEP can help to form an alliance between parents and program personnel, 
so that evaluation becomes an integral part of the program for parents. 
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Coordinating Spon*or: Ferguson Florissant School District 
Parent-Child Early Education- 
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Eating during pregnancy: its effects on yours and baby's health 
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Establishing sound eating patterns: the first three years 


































'Planning balanced meals v , 


































Junk food: its effects on health and behavior 
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Health and Safety 
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What to check before calling the doctor 


































Recognizing symptoms of childhood diseases 


































What to know about first aid 


































Ways to prevent accidents 
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^Growth and Development 
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What is typical? What to expect and not to expect from birth 
K through 3 years of age 
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Ways to prepare your child for success in school from birth — 
in terrns of physical, social, emotional and intellectual de- 
velopment/ including speech, language and coordination 
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How babies learn to talk and develop language m 
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The value of play — developing social and intellectual skills 
































Selecting toys and books appropriate for your child 
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1 Making and finding no-cost or low-cost learning games 




































■ Ways to increase your child's self-confidence " • 


































1 How to get your child to, willingly do what you want him to 


































Ways individual differences" in personality and abilities of 
■ children and parents affect the parent-child relationship 
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I How to select and prepare babysitters 


































How to select day care, nursery schools, preschools 


































■ Dealing with special problems — bed wetting, slow to talk, 
1 pxky eeting, going to bed without a fuss, etc. 
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[ • Use and abuse of TV and its effects on learning 


































L Teaching values, morals, responsibility 
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1 Sex education and sex roies 
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1 »\ays ta listen and talk with each otner 
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1 • Parent to parent 


































1 • Parent to child 


































1 reading body language 
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[ Making decisions as a family x 


































Ways for farnifies to talk and work together to solve 
problems " . > 


































^Determining what we'expect of each other and who doej 
what — around ttoe house and with the children 




































Preparing brothers and sisters for a new arrival " 


































r-omoting healthy,* happy relationships between 
brothers and sisters 
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Vr ays to maintain a good mawiage and help it develop 
as children become part of the family 
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* Living in harmony together or near relatives, m |aws 
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; SPECIAL NEEDS OR CONCERNS ,« % 
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- * Prioaring for childbirth f* 


































Scecial concerns of the high school age parent 


































Fa-nily adjustments related to divorce 


































Sc-ecial concerns of the single parent 


































Special concerns of the blended famKy (his, hers, ours) 
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.Arreting and helping a child wijh a oandicap or a 
iseciaf problem 
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V. PROGRAM EVALUATION 

« 

In Chapter II we mentioned that decision makers seeking to evaluate 
their programs have t at their disposal a number of techniques for gathering 
the relevant information. These techniques and their strengths and weak- 
nesses are discussed below. % L 
^ TECHNIQUES FOR GATHERING DESCRIPTIVE' INFORMATION 

Of all the classes of data, the one used most widely in programs for 
parents is simple descriptive information, All the programs we surveyed, 
regardless of their goals or their organization for service delivery, re- 
ported collecting some kind of descriptive data to document parents' oppor- N 
tunities for involvement and the ways they choose to participate. In addition 
to being useful in planning and managing the program, this kind of information 
is needed for" cost analyses and to meet federal^ccountability requirements. 
In fact, determining the extent of parent involvement is the only required 
evaluation of parent activities: in their annual performance reports, state 
education agencies (SEAs) must provide data, aggregated across all programs, 
on the number of parents participating in PACs and other parent j^ctivities ; 
the number of LEAs that provide Title I funds for PAC activities; community 
involvement as measured by, the number of parents, both Title I and other, 
who participated; and Sustained interest as measured by the mean number of 
persons who attended PAC meetings/ The form to be used in reporting is 
presented in Figure 3; the data required are minimal. 
' Unobtrusive Measures 

In most cases LEA staff and constituents want to know far more dbout 
what their program is doing and, tailQr the descriptive information they 
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Advisory- Councils . ' 

1. Number of elected members of an advisory council who: 

a, were parents of Title I public school^studertts 

'* 

b\ were parents of Ti t tle I nonpublic school students- 



c. 



received training (not necessarily J\itle I 
funded training) related to adAsory council 



activities \_ ^ 

^ dumber pf local educational agencies that provided 
'Title I funds for advisory council activities 

Parent* Activities ^ <* 0 

1. ' Number of parents of Title I* students involved in the 
following Title I activities (on each line, count a 
parent only once): . _ „ . t \ y 

a., attended at least* one school advisory fcQuncil 
meeting 

b> participated in project planning, implementation, , 
andy'or evaluation _ j * 



c. worked as volunteers in Title^I activities 

outside the Title I 'classroom (e.g.., chaperoned 
activities, provided transportation, etc.) 

2. Number of parents not included, in 1 above (e.g^, 
patents of non-Title I students) who were involved 
in one or more of the Title T activities listed 
*8nder la-d. * « 



Figure 3: ESEA* Title I Parent \ct*&ity Information 
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gather to their own needs. That information can generally be gathered by 
unobtri*sive measures, such as simple count$ of contacts between parents &nd 
the program- -attendance at meetings, number of parent^who participate in 
volunteer activities or visit^the classroom, number of home visits, number 
of progress reports ^igned and returned, number of 1EP .meetings requiring ^ t 
little effort., ©ft en conveniently placed sign-in sheets, a -numbering system 
for home visits or progress reports, or a checlist of IEPs completed suffice. 
In other programs, contact records include details, such as^topics discussed, 
material distributed, referrals to other agencies, new or changed needs or 
or interests, and plans for further contact (for example, see Figure 4). 

Unobtrusive Vat a can provide answers to questions §uch as .the following: 

• How many families werp served in a given period? How does this, figure 
compare with the estimated number? - 

• What types, of service were given (e.g., home visits , -parent confer-,, 
ences, written reports, field trips), and how often? 

• How many appbintments were massed? What reasons were given? What 
follow-iip was done-? " , * 

. iff 

How many parents continued with the program? Hpw many withdrew? 

'* • How many families needing services were^ i4entified? , How many received 
services? Why did the others not receive services? 

* • How many parents participated in volunteef activities? How often? 
What activities? 

• Did parents give presentations about the program or write letters of 
support? How many? To what t audiences? 

* * ' 

• What recommendations and decisions were made by PAC or other parent 
groups? Were they followed?, • 

The same questions can be 'case -in individual terms, and examination of in- 
dividual participation can provide useful information for planning programs 
for individual families. . • 



SUMMARY OF CONTACTS 
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Figure 4: Parent-School Contacts (from Link Parent Interest Survey) 
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Thus unobtrusive measures are potentially useful for all types 6i 
_j>^ogram: those that simply share information; those that involve parents 
as teachers; those that rely bn parents as volunteers; and those that include 
parents as policy makers. In terms of pjogram goals, they are most valuable 
in describing changes in parental behavior toward schools and related organi- 
zations. 

These measures have several advantages. Information is readily avail- 
able, and easy and inexpensive to collect: program personnel and parents 
provide the data each time they meet. Recording each contact takes only 
instants, and with care the information should be accurate and reliable. 
Only three cautidrrs are in ord&r. First, since accuracy is essential, those 
who keep the records should know ^their purpose and be trained in their use. 
In some cases, simply understanding why information is reco^ifed will be 
sufficient motivation for accuracy. In ethers, reminders may be needed 
from time to time, and records may have to be checked periodically for com- * 
pleteness and accuracy. Hence our second caution: it is helpful if someone 
is assigned responsibility for Sverseeing the data. And third, record 
systems should in general be simple. There is as much risk in an over- 
elaborate system as in one that contains-to-o little information. Too often 

4 

a cumbersome system becomes a burden to program staff and parents, and record 
keeping thus becomes less^reliable,. 
Parent Reports * 

A second source of 'constructive and useful information reported by staff 
in many programs 'is periodic reports fron parents about their involvement 
in the program and their reactions to it. Almost every program we ^jrveyed 
uses som^Jdnd of questionnaire or interview for that purpose. Most have 
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# developed their own protocols to deal with questions such as: 

• Was the program useful? 

• Was it efficiently and sensitively carried out? 

• Did it do what the parents expected it to? 

• Did program personnel provide enough information, and in a form 
that was useful to parents? 

• What might have been done differently,- and how? 

• Did the program make any difference in the lives of -the parents x 
or their children? 

Like unobtrusive measures, parental satisfaction scales are reasonable in- 
dicators of the success of all four major program types. They are most valu- 
able in documenting changes in parents' attitudes toward their children f s 
learning and toward the schools. Taken together with descriptive data pro r 
duced through unobtrusive measures, they document how parents feel as well 
as what they do. 

Reports of parental satisfaction are also relatively easy to acquire. 
Parents are usually willing to provide the necSs^ary information. The form 
used may be as simple as that presented in Figure ,5; or it may be far more 
complex, requiring that parents rank the progrant-on features such as quality 
of communication between parents and staff; parents' feeling of efficacy 
within' the prograln; their perceptions of changes in their own attitude, 
knowledge, or behavior, and of changes in *heir children. Often these 
more complex questionnaires are completed in the presence of a staff member - 
who'can help. parents with them. They may also be supplemented by a structured 
interview. Again, we advise simplicity. Parents may not respond to a 
questionnaire that is hard to understand or takes too long to cdmplete. 
Those who design these f<3$ms may find that "less^s more." ^ 

4u ' 
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As a result of participating in thi% program, ^1 feel ° 
that my .child: 



— Has shown improvement in speech and language skills^ 

— Has shown little or no improvement in speech and 

language skills , . -^r 

Please explain. 



As a result of participating in this program, I feel 
that I (a's a parent)^ s 
« 

— -Have gained in my understanding of my child's 
needs and my ability to help him 



Have gained little or no new understanding of my 
child's needs and feel no better able to help him 
with it than I was before I cam to the workshop. 



yes 



yes 



Please explain, 

What parts of the program did you find to be most helpful, and why? 

r V 

^ » ft 

* 

What parts of- the program did you find to be least helpful, and why? 



What changes 'would you recommend to be made in the program for next year 

* 

Please'ctieck one of the following: 

, ' I participated in almost all of the program^ 

■ « I missed more than five days of the program (or c3id not participat 

in full-day sessions) „ i • 

• V v 

I participated in /less than half of the program, ^ 



< Figure 5: Example of Questionnaire for Parents 
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Although questionnaires arid interviews are valuable in documenting 

parents 1 feelings afy>ut the program and its effects on them and on their 

children, we must also raise some cautions about them, particularly if they 

are administered by program staff. Aside from the natural problem the staff 

may' have in Keing objective about 'their own program or performance, parents 

may try to M please the teacher 0 by providing what they think the information 

seeker wants. One director pointed out: 

It is my observation that subjective reports often amount to 
stroke? for staff. If you have a dynamic trainer, or even 
an adequate one, you will often find persons responding to 
[him] and unable in any systematic'yay to evaluate the efficacy 
of the training provided to them. 

Parents may also report differently to different interviewers. They are more 

likely to try to please an interviewer they consider someone in authority (e.g., 

a program director) or s&meone they do not want to hurt (e.g., a teacher or home 

visitor). One way of dealing with this is to use parents more directly, assuming 

that they will be more honest with other parents. A ^roup of parents, perhaps 

PAC members, might help^decide what information should be asked. With training 

they^may even take charge of this aspect of evaluation, conducting interviews, 

collecting questionnaires, and even participating in data analysis. ■-•A 

Firially, several program directors reported th^t they regularly collect 

this information from parents who leave the program. Responses from this group 

often tell where'jhe program has gone awry. Such information is particularly 

useful for improving future efforts^ ' 

Rating Scales * • 

"* ** — ■ — • 

A third prevalent means of gathering descriptive. data is -parent ratings of 
the instruction received and the impact of the program on them or their 'child. 
Parents are asked to assess how much they are learning, and whether they are 
interacting with or instructing their child differently .after participating 
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Unfortunately,. rating scales are often thought of as measures of program 
impact, and issues of technical quality quickly arise.* Developing a scale 
and then adequately assessing its reliability and validity is a difficult 
and costly process, often beyond the scope of Title I parent programs. Bor- 
rowing scales .developed by others has occasionally been moderately successful 
in attempts to rate changes in parent beha\&ior, but we found only two sets 
of rating scales that have been used with satisfaction by several programs: 
the Parent Attitude Checklist CBoyd and Stauber, 1977), and the Home Base 
Survey and Parent .Survey, adapted by the Yakima, Washington, Public Schools 
from the Parent Education Model of Follow Through. The former was developed 
for a home-visit parent education program. Parents -ra'te their attitudes and 
behavioral reactions to teaching and child management situations along a 5- 
point scale ranging from "never 11 to "always. 11 The items assess parents' 
knowledge of and participation in. techniques of child management and teaching, 
and parents! role as teacher, their sel^-conf idence, and their attitude toward 
child discipline. 

4 

The Yakima Home Base Survey and Parent Survey consists of brief questions 
that are answered on a scale of "strongly agree" to "strongly disagree." The 
questions address parents' perceptions of changes in their own and their 
child's behavior, $heir role as a teacher, and- the appropriateness of the 
home environment. Both scales are reviewed in the Appendix. 

Personnel in 3everal oth,er programs reported that they had tried to 
use existing rating scales to gssess changes in parents' attitudes, but 

* For a brief but thorough discussipn bf traditional ^asureinent considera- 
* tions, the reader is referred , to the 'resource book Assessment in Early 
Childhood Education" (Haney 5 Gelberg, 1980). 
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with little success. In the interest of avoiding unnecessary effort for 
others, we will briefly mention a few of the scales feo us^ed. The first was / 



Blaine Porter's Parental Acceptance Scale, Designed 
aged six to ten, this measures parental acceptance o 



for parents of children 
children. Parents 

rate themselves on a self-inventory questionnaire** acc ording to their feelings 

and actions in relation to their child. Another instrument, the Eli^s Family ^ 

Opinion Survey (19S2-1954), measures feelings of ijitf a- family horaeyness/home- 

lessness, while y§t another, the Index of Parent&l Attitudes (1976), measujes 

parents' contentment in their relationship to their children. A fourth scale 

that initially was rather widely adopted but was later discarded is Norma 

Radin's Parental Attitude Research Instrument (PARI) (1958) or its Glasser- 

Radin Revision (1§§8). It' has been used as a pre- and post-measure of changes 

in parents 1 attitudes, and contains Likert-type multiple choice items. Each 

of the 113 items uses a forced-choice scale. The respondent is asked to 

agree strongly, agree^roildly, disagree mildly\or disagree strongly, and 

replies are scored 4, 3, and 1 respectively, \otals are obtained for 23 

subscales, each containing r S items. . 5 J 

f 

, The, paucity of rating, scales that have beejpf.successfully adopted outside 

; ■ 

the program for which they. were developed ljSfcds us to make two suggestions. 
First, it 'is wiser for ECT^-I^arent education programs to make only modest 
requirements of the technical quality of a parent rating scale, to develop 
one tied directly to their program, and to use it to improve the program. 
-It can be a rich source of information about what parents think they have 1 ♦ 
learned and how they think they have changed, though it may not be totally ■ 
accurate or give a full picture of program impact. • After all, as research 
suggests, the'supposejd beneficiaries of intervention programs are ^ensitive 
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abbut changes in their own altitudes or behavior. Moreover, programs for 
parents may lead not only to specific short-term changes, but to lozj-terz ) 
adjustments in attitude and thus in behavior. < Self-rating scales ncnethe- 
less offer valuable descriptive information on parents' reactions tc the % 
program. If the items of the scale are tied to objectives, program staff 
can use the data to improve their work. 
TECHNIQUES FOR MEASURING SHORT-TERM IMPACT 

In some cases it may not be enough to collect good descriptive data on 
what the program is doing, how it conforms to plans and requirements^ and 
how participants feel about it. In particular, personnel in parent education 
and parent training programs often want to assess the short-term impact of 
the program on parents or children*'. The assessment of young children and 
of short-term program impact is> complex and challenging. It is discussed in 
two other resource books in this series, Short-Term Impact Evaluations of 1 
Early Childhood Title I Programs (Haney, 1980), and Assessment in Early 
Childhood Eduacation (Haney and Gelberg, 1980) . ' In this book we confine our 
discussion to the measuring of short-term program effects on parents. h 

For programs*that intend change in parents 1 knowledge, behavior, or 
attitudes toward the child, two foci for evaluation have emerged: pirent- 
child interaction or teaching style, and the amount of appropriate stimulation 
available in the home. Program directors reported the t^^o^ tests, obser- 
vations, and teacher ratings to assess the former, and formal or inf:$mal 
observation and rating of the home environment to assess the latter. 

i 

At first glance, .it would seen that the simplest way to' determine what \y 
a program participant has learned is through a test. Tests are relaiively 
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. easy to givfc and score and their results are simple to analyze. Moreover, 
if the test is based on criteria derived from the curriculum, item analysis 
can show program weaknesses and can serve as a basis for recycling parents 
through material not, yet learned. But there are problems with the use of 
tests. First, almost no standardized tests are available; and developing 
tests of even modest technical quality. is a task beyond the capacity of most 
ECT-I parent programs.- We found' only one test jwhose developers have system- 
atically attended to quality control: the Parent As A Teache/ Inventory, 
reviewed in the Appendix. This measures program impact, on the interaction 
of preschool children and their parents. It can be given individually or 
in groups and takes 15 to 30 minutes. .Parents, are asked how they respond 
in a variety of specific interactions with their child. The responses are 
then coded into five areas: acceptance of the child's creative development, 
frustration about child rearing, feelings about control and discipline, 
understanding of children's play and. its influence on development, and con- 
fidence as a teacher. 

A number of parent programs, particularly ^hose far parents of handi- 
capped children, have developed criterion-referenced or competency tests 
keyed to their curriculum. For example, Dallas, Texas, has one (Macy, 1978), 
as has Project RHISEE/Outreach in Rockford, Illinois (Smith, 1979). Such 
tests are most useful in programs aimed at specific changes in parental 
behavior. Thus programs witft a behaviorist 1 philosophy might define rein- * 
forceraent procedures for parents to learn? designing several test items to 
measure their knowledge. Of course, for programs with more diffuse or in- 
dividual goals, ev^n criterion-referenced tests are difficult to devise. 
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Beyond the limitations of the measures, there are other problems in 

/ 

trying to test parents. Even if limited technical standards are accepted, 
taking tests is often frightening to parents, particularly those who^ave 
had unpleasant experiences in school. Moreover, since many Title I parents 
read'poorly, simply taking a test may be almost impossible. Third, because 
parents differ so much in what they bring to the program and expect to learn 
from it, a single test cannot adequately assess program effects'. Finally, 
there are ethical issues. , Many program planners feel that tjie testing of - 

parents is an unwarranted intrusion into child-rearing practices--an area 

\ 

traditionally left to the family. 

As a result of these limitations, we found that few programs formally 

test parents. Many of those that have tried have abandoned the egfcvrt. In 

those that hare not, personnel are uncomfortably aware that 'the tests do not 

/ £ 

adequately reflect program objectives or respond to the, feelmrfs and needs.' 
of the par.ent group. Most-programs therefore have recourse tq^other methods 
of assessing program impact. ^ * 
Observational Techniques 0 ' 

Instead of using iests, some programs have turned to observation. .Here 
observers systematically record parents 1 behavior according to' predetermined 
guidelines. Observation techniques are particularly appealing because th^ey 
assess parental behavior directly and apparently show how parents practice 
-what they have learned. The>*also provide program, personnel with specific ^ , 
data for planning further instruction. ' , 

We found three observation techniques in use: observation Of the^ KQjne 
environment, naturalistic observation of parent-child interaction, arfd con- 
trolled observation of parent-child interaction. . We will discuss ^ch o.f . 
these in turn. ' . * <, 
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Measures of home environment . A number of programs assume that one 
effect. of the program will be to improve the home environment by increasing 
understanding of the needs of the children. We found several environmental 

' assessment inventories in the literature, but with few exceptions, little 
evidence of- their use beyond the prGgram for which they were developed* One 
measure was cited over and over again: the Home Observation for Measurement 
of the Environment * (Caldwell S Bradley, 1972), designed for use with children 
at. risk of developmental delay due to environmental deprivation. If consists 
of a checklist completed by a trained interviewer who visits the family at 

^ home. The interviewer records items f in areas intended to assess the frequency 
and stability of adult-child contact, amount of developmental and vocal 
stimulation, need gratification, emotional cPimate, avoidance of restriction 
on motor" and exploratpry behavior, available play material, and home character 
istics indicating'?parental concern with achievement. The observation takes 
about one' hour. 

<A second measure is the Cognitive Home Environment Scale (CHES) developed 

tiy Radin § lveikart (1966). This also measures the degree of cognitive stimu- 

lati&n in the home, throiifh a combined observation and interview technique. 
. «» - » 

It *has been used by several intervention programs, who reportedly found -it 

satisfactory. Both scales are reviewed in' the Appendix. 

Proponents <!?f home observations believe that they yield greater insight 
into program effects than do artificial testing solutions, since they more 
realistically portray the kind and amount of stimulation and support the 
child receives. Again, however, those considering the use of home environ- 
ment measures should* be aware of potential difficulties. % # . 
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^ First, of course, home observations are unavoidably intrusive. Second, 
if standards of informed consent -are upheld, * parents are aware that their 
home is to be assessed and may try to make a favorable impression, A quick 
cleanup, a hasty trip to the store for some inexpensive but "appropriate" 
books, a display gf play material^hat may not normally be accessible are 
all easy ways to get ready for the assessment—and distort its validity. 
Predictive validity is also an issue. Although Caldwell has shown some ' 
eyidence that home environment and child outcomes are correlated (1977), 
no other instrument we know of has been able to do so. 

• Third, 'the observer is a source of -bias. ^Selective inclusion or ex- 
elusion" of objects or events is the most obvious possibility. No observer 
sees everything, and selecting among the myriad of observable events is 
critical to the portrait painted by the observation. Extensive and repeated 
training is tHe sine^pua non for gathering reliable—and relevant — observa- . 
tional data. /However, such training is costly; and this must be considered 
in deciding whether to make home observations. 

Observations of parent-child interaction- . There are many parent -child 
interaction scales in the literature (see Measures of Maturation , 1973, for 
an extensive list and description). Although they are designed to asse^v.. 
the edudational climate of the home, there is no agreement on what variables 
contribute to it. Hence there is the risk of evaluating families by personal 
factors-=£ . g. , housekeeping standards — that are really beyond the province 
of the program. Moreover, most of these scales are not applicable to or 

'raanageable by ECT-I parent education programs. Before discussing the few 
examples we found that might be useful* in thes^prograras, let us examine 
why . observations of parent-child interaction j are worth considering as a 

^leraent in evaluating parent programs^ ^ * 

ERIC ' . 43 . 
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The main advantage cited to* justify* these observations is that they 
yield a rich body of derailed data about what is really happening between 
• parent and child. The argument is^ "Look not at^what they say 'but at, what 

they do." If the data are collected reliably, they are direct* ; evidence of 

% 

% what parents do under specific circumstances. If, for example, it is a goal 
of the program that parents respond to children's utterances with full 
sentences, observations can determine how frequently and^re^^arly they do 

01 
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so in daily events such as mealtime or getting ready for bed^ or if the 

r 

goal is to help parents teach through positive verbal reinforcement, obser- 
vation can show how often' a mother praises a child for a task completed. 

When the parent behaves consistently in ways suggested by the program, a 

* * < - • 

reasonable assumption is that the program is responsible, It has "worked." 

****** * 

1 S?ome/ programs extend the usefulness of their observations ~by video- 
.taping them p\d replaying the .tapes for subsequent program use. For example, 
a video-tape of a mothe^r teaching her child to use a new toy mi^ht be played 
back with the mother, all owing 3 her to "see herself as others see her" and 
to identify elements of her teaching style that she or program staff feel 
could be iiflproved. , 

3 4 * 

Observations of parent-child interaction range from scales like the 

Parent Behavior Inventory (Boyd and Stauber* 1977), in which home, teachers 

observe parents informally and rate* their performance in various teaching 

and management tasks, to far more sophisticated and expensive measures. 

For example, the Mutual Problem-Solving Task, developed by Epstein, Schwartz 

and Merce (1975), involves systematic observation of mother and child baking 

cookies together. Behavior is observed and recorded at time-sequenced 

* • 

intervals and then coded by highly trained staff. Categories of behavior 
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include affect, task involvement, 'requests for assistance, and responses to 
requests for assistance. 

Levenstein, at the Verbal Interaction Program, h^s also developed an 
observation technique (Levenstein, 1978). In this case, each mother- child 
pair is video-taped for 'ten minutes of interaction in a standard play situ- 
ation. The tape is then coded using a program-referenced Maternal Interactive 

Behavior Scale that includes the following items: gives labels; gives colors; 

> 

describes actions; gives numbers , shapes; gives information, praise; aids 

divergence; smiles; replies to chi,ld; gives no reply. Video-taping adds to 

the expejise of the procedure, but it also allows for greater quality control 
V m 

than scoring on the scene. Moreover, the tape can be played to the parents. 

Thus evaluation data can be introduced into the process of program j? 1 anning . 

Although observation techniques are appealing and there may be no real 

substitute for Vtaking a look al th& program," several issues deserve thought. 

* First, it is important to understand that the process ,of observing often 

affects the behavior .observed. A parent whose teaching style is being as- 

• \ 
sesaed may use positive reinforcement in teaching a new ski 1,1, and refrain 

from scolding or punishing a child, but behave somewhat differently under 

normal circumstances. Second, most programs make only a single observation, 

or two at the best: one before the program begins and one when it ends. 'As 

responses are likely to reflect momentary fluctuations in parents 1 typical 

behavior, judgments based upon a single observation can be expected to be of 

limited* validity. 

Third, observation techniques require a highly trained staff : using a 
carefully designed protocol, extensive coding procedures, and often sophis- 
s ticated analysis techniques.^ Video-taping requires additional technical 
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staff and hardware. Together, 'these elements make observatn^e^vesg^ 
Finally, observation is among the most intrusive types of evaluation. To 
the extent that issues of invasion of privacy -and family rights are salient 
to program delivery, they may argue against use of these methods. 

Teacher ratings . In many programs teachers are asked to rate parents 1 
attitudes, knowledge, and behavior toward their child or the schools — the ^ 
same questions as in parent assessments, but from the perspective of the 

teacher. Most of these rating systems are simple checklists of prograjn (or 

J 

individual family) objectives, and teachers rate growth toward those object 

tives. Rating is easy and inexpensive to do. 

) 

Like parent reports, teacher ratings are a reasonable way o# assessing 

how programs affect parents' attitudes, knowledge, and functioning toward - 

* j 

their child or toward the schools. Under careful supervision, the information 
they yield should- be reasonably accurate. A well-trained and perceptive 



to say with some confidente how well the lessons were learned. Howe 

• 7 * 

circumstances are not always ideal, and we v jnust once again mention p 



teacher who has worked with a parent or a parent-child pair should be able 

fever, 
['possible 
sources of error. 

First, because teachers make an intense commitment of time, energy, 
and often emotion to each family, they may not always judge cffiange objectively. 
This is particularly true if they believe that change is also a measure of 
their own performance. Second, teachers, like everyone else, br^ng to their 
job values and expectations that can* affect the way they interact with and * 
assess parents. For example, a teacher who perceives k mother as welcoming' v 
and pleasant during home visits may also see her as cooperative and eager S . 
to learn. Conversely, a mother who seems tired, untidy, or un enthusiastic 
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may be judged uninterested in the program or even in the child. Separating 
the bias of teachers' 'attitudes toward certain parents from their assessment 
of program effectiveness needs careful thought. 
Summary 

We have se^n that evaluating the short-term impact of programs for . 
parents raises some special difficulties. The most conspicuous of these is 
the almost total absence of reliable and valid evaluation instruments and 
procedures. In addition, program objectives usually span a broad spectrin, 
and objectives for individual parents are often unique; hence the problen of 
assuring that the assessment of program goals is valid and the evaluation 
findings are representative. For these reasons, we suggest that ECT-I 
parent programs Concentrate on descriptive studies rather than rigorous 
studies of short-term program effects. The credibility of descriptive studi 
can be .enhanced by triangulating, or by gathering information from nore than 
one source. For example, program evaluation might include the following com 

ponents: . - ^ 

A rating scale to assess parents' perceptions of their own learning 

• A rating scale to determine staff perceptions of parents' learning 

• A Survey of parents' satisfaction with 'the program 

• A reading test to determine whether the child is prepared to cope 
with the tasks of early schooling. 

TECHNIQUES FOR MEASURING LONG-TERM IMPACT AND SUSTAINED EFFECTS 

Decision makers in programs for parents may also 'need to lgaow whether 

changes in parents' Knowledge, attitude, and behavior remained after the 

parents left the program and whether long-term goals were attained. For 

example, if at the end of the' program parents* regularly read to their chil- 

dren mote often than formerly, do they continue to do so? After several 
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years of participating in program activities, do parents devev^p positive 
attitudes toward education and hence motivate their children throughout the 
school years to study and learn?. Decision makers want to know whethe'r par- 
ticipation in programs for parents prevents or reduces the likelihood, of 
future school problems such as dropping out, truancy, ^retention in gratie, 

V*" 

or persistent infraction of s t chool rules. Finding the answers to these 
question's requires a longitudinal data base; that is, recoxds on children 
and families must be kept .for as long as possible, preferably from the time 
children enter school until they leave,* 

Longitudinal data can also provide decision makers with useful informa- 
tion for planning parent programs. For example, they can show whether the 
children of parents who participate in home visit programs do better in 
school, or later drop out of school less frequently, than children whose 
parents do not participate. If they do, an argument, could be made to con- 
tinue the program. If they do not, program planners might look for alter- 



natives 



** 



LEAs that have a h^jitudinal data system or are, considering developing ^ 
one might do well to include information about families 1 participation in r 

parent programs. The resource book Longitudinal Information Systems in 

' \ * 

Early Childhood Title I Programs (Kennedy, 1980) provides helpful information 



^ .4 • - ■> 

* One could, of course, design a longitudinal study tl^lKontinues far 
beyond the school years. Indeed, a number of such *sfl Bs have been 
done; see, for example, the Fels study (Kagan et al.^!§62) dr Lois 
MuTphy's study of >chifdren's coping ability (Murphy, 1£74). However, ^ 
since the use of Title I funds is confined to programs during the school 
years (usually kindergarten to grade 12), we will limit our discussion 
to that period. 

\** Such comparisons must be made with caution, since other events un- 
doubtedly also contribute to the difference. 
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on how to set up and, maintain such a system. However, there are at least 
some difficulties in maintaining longitudinal information that are particu- 
larly germane to programs forjparents . 

,The first difficulty stems from th| mobility of any population. LEA 
staff -agree that Title "i 'families are for the most part highly mobile. Many 
move from home to homeland in doing so are ]jbst to the LEA. Moreover, with 
the increasing rate of divorce and'with changes in fiamily constellations, 
children o'ften live with different parents or parent surrogates at different 
'times in their, school years. A longitudinal data file would probably be 
unable to track such changes. :*v 

Parents 1 right to privacy is another important issue. ^It might well 
be argued that to date, at least, the mandate of schools does not extend 
beyond the child, ^nd that inclusion of long-term data--even about parents 1 
participation, but more particularly* about parents 1 success or failure in 
school programs--is a serious invasion of privacy. „ * 
TECHNIQUES FOR LINKING PROGRAM ^RACTICE TO OUTCOME 

Many decision makers want not only to know whethes^fhe program did what 

i 

it promised to, how well, and how parents feel about it, but t(F understand 
how program input is linked to program effect, and why the program^may 
have unanticipated consequences. Qualitative evaluation, particularly when 
it is combined with quantitative program description, is a promising means 
of providing this information. As Apling^and Bryk point out in the resource 
book Evaluation for Improving "Early Childhood Title I Programs (19803: 
"These methods resemble each other J>nd differ from others) in that they 
are based on the' idea of 'the evaluator as instrument.' Less emphasis is 
placed on standardizing data collection act^ities, and' much is left to the 
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- individual evaluator to decide as the evaluation proceeds" Qp. 27). Since 
there are so few standardized measures of program impact on individual 
parents, these qualitative methods are' worth considering. Some of the 
program improvement practices Apling and Bryk recommend can be easily adapted 
v for parent programs and are particularly amenable to parent or PAC involve- 
ment. These include self-study and some process methods. 

Self-Study . Self-study is a form of program review in which participants 
(in this case teachers and parents) assess their own program. For example, 
in a program that used home visitors to teach parents and children, the 
♦director wanted to know whether the technqiue was appropriate for all the 
families enrolled. She also wondered whether there were other eligible 

* m . 

parents in the community who might participate if the program were organized 
differently. She found that her staff, too, were not sure that their actiy- 
ities met the heeds of all their families. As their concerns became focused 
more specifically, the original set of broad questions was refined. Program 
staff also identified parents who they thought would be interested in and 
^ capable of participating in a process evaluation. These parents were ap- 
proached and an evaluation study group was formed. ^ 

The group -met and defined the following seemingly simple questions: 
j* What services, is the program providing? ' 

• Do families receive home visits as ^often as they were promised? 

• Do some families receive more or fewer home visits than others? 
- Why? 

• How do families assess home visits? 

• How do program staff Assess home visits? 

• What are the implications of the answers to these questions for 
*next year's program? 
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Tasks were then assigned to^ individuals or subcommittees. Fortunately, the 

home visitors .had descriptive record's of all their visits.. To -examine the 

^first question, a subcommittee reviewed these and compiled a profile on each • 

family. The profile showed how many visits had been made, and when; and 

\ ' . • ■ I 

visits schedyled and then cancelled, and by whom. It also/provided a brief 

" / 

account (two 'or three sentences) of each, hpme visit. / 

A second' subcommittee was asked to design an int-e/v^ew to find out how 

■ - ; 
parents felt about home visits. Together with the director of evaluation 

'in the LEA, this team designed an open-ended interview to be conducted by 
' parents. The director of guidance was brought in to /help plan, sessions to 
' teach parents the skills of interviewing. The team also extended its mandate^ 
slightly b-y planning a similarfTnterview for home visitors, the -program 
director, and the administrative assistant, so as to evaluate-the efficiency 
of hofoe visits from all perspectives. . c , 

• 'The ; next task'was to review the cost of the project. The prqgram 
director did this, coming up with- figures on the total cost of the program 
and on- the cost* of' individual components suc£ as materials, staff training, 
consultants, and preparation for and conduct of home visits. 

The subcommittee now^ejpnvened'. Parents were selected andl 
hold interviews, interviewing first one another and then thf -regaining 
program participants. The full group % including the evafuators ,° met aga^Q 
several times to analyze the results, translate' them into plans for the 
future, and finally write their report, y - . • 

The report described the committee' s^indings.-' Among them was evidence 
that most families were receiving fewer home visits. r ,than promised. Two* 
groups were receiving- substantially fewer: working mothers and<.ma*hers 
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under 20 years of age. The first shortfall seemed to be*due to scheduling 

difficulties: mothers wereeunavailable during the working day. The second 

occurred because very young, mothers did not find home visits helpful, saw 

the visitors as monitors or social workers, and reported being uncomfortable 

■ I 
talking with them. Moreover, interviewers found that many participants , 

felt isolated and were unaware^of the community services available to them. 

Armed with the study report, program personnel made 'the following- 
changes ; 

• Systematized scheduling so that hom^ 'visits planned and completed 
were regularly recorded in the program office; this was to motivate 
.staff to follow the home visit 'schedule as planned. 

. • Hired one home visitor to work; late afternoons, evenings, and week- 
ends, and hence be available to working parents. 

• Hired someone to survey the community and list the available services 
and other resoyrces as well as the means of gaining access to them;^ 

a monthly newsletter was issued to update this information. 

• Planned group activities where, mothers, could meet to discuss issues 
of raising and educating children and other concerns. 

Jn this example, the program staff were the ones who could^use the informa- 



, tion generated by tlta^elf-study^arthough the repoJ||was also available 

i ► 

to the administration, ,the schopl board, the PAC, and program participants. 
In addition to program improvement, the* evaluation- served two other functions. 

First, data collection was expanded to include continuous updating of family 

4 o 

service profiles. Second, the PAC, interested in the extensive involvement 
of parents in the evaluation, recommended similar self-studies for other 
phases of the district's Title *I program. 

^ Self-study requires a great deal of time from all participants. If 

* • t * 

« 

they understand its 'purpose and view it^ as an opportunity to improve the 
program, it can greatly enhance communication between parents and program 
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staff beyond individual parent-teacher contacts. On the other hand, it is ; 

essential that the effort be well planned and supervised so as not to digress 

„ from its purpose. Committee members must keep in mind what: they are trying / 

to do; and they must receive the training and direction they need if the ^ 

results they report *5re to be useful for v program improvement.' 
«> » 

Process Evaluation . Apling and Bryk (1980) .describe several^, types of 
process evaluation. In 'this 'resource book we will consider them as a single 
class. If the general approach of the process study seems to fit the evalua- 
tion needs of a particular pjrogram for parents, then evaluators and program 
planners are referred to Evaluation for Improving Early Childhood Title I 
Program for help in selecting appropriate procedures. 

In many ways process studies are similar^to self -studies , but unlike the 
. latter-' they involve the services ^f persons other than program staff and 
participants. The outsiders may >e members of the LEA evaluation department, 
an independent evaluation company, or consultants from a university. Of 
course these professionals jnay increase the cost of the evaluation.- However, 
they may also provide more objective information about the program, and the 
data- and subsequent reports may have more credibility with decision makers. 
Hence, a prpcess study may be useful to a wider audience than a self -study. 

Essentially, a process study looks at the links between program input 
and effect. It enables program planners or evaluators to go beyond what 
happened and begin to draw some conclusions about why it happened and what 
^Influenced the outcome, let -us ^njM^r two examples of ways in which 
process evaluations were used. In a program for parents in a Colorado 
community, a. consulting council of parents, staff and technical service 
representatives, and physicians was formed to advise the project staff on 
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policy and program operation, to make recommendations in areas of psycholog- 
ical, social and medical services, and to serve as a link to 'the community. 
However, before long the project director noted that things were not goijig 
smoothly: the council seemed to be divided into a number of factions. She 
called in an evaluation' team from a nearby university, and two observers 
attended each of the remaining council meetings. Using observation protocals 
developed in advance, they recorded certain key features of the meetings. 
These included: 

t Who did what percentage of the 'talking at the meeting 

• Who raised issues or questions for -discussion ^ 

• Who responded to what kinds of. issues ^ 

• -Who voted how on key issues 

• What was the tenof of responses when an issue was raJLsed by parents; 
t by professionals; by staff 

t Whether issues were resolved by the end of the jneetings 

• If questions were left unanswered, whether appropriate follow-up 
activities were developed./- *> 

The evaluators also interviewed council members to investigate questions 

such as these: « * 

• Who determined meeting time and agenda? . 

• How convenient were the times to .the various* members? 

• What did members perceive as ttfe most important purpose(s) of the 
council? * •* , 

• How well did they feel the cquncil Achieved these purposes? 
Based on the results, the evaluation team then wrote a report citing ways 
in which the advisory council was working effectively and ways in which 
they were unintentionally undermining their ow^i efforts. The report went 
on to suggest how* the council might increase its effectiveness. 



00 



A different kind of process study was reportedly a parent education . 
program in Massachusetts, which provided a comprehensive system of diagnostic 
assessment of young children and education far parents:^ The program had a 
separate evaluation staffs After the^project had operated ,for several months 
the evaluation staff wanted to know 'how parents viewed the tQtal program and 
its various component services, and particularly whether staff and partici-, 
parits understood the program in the same way, And er the direction of a 
.member of the evaluation staff, four, interviewers held op^n- ended Interviews 
with tKe program director, teachers, physicians, nurses, social workers, and 
parents. Using the program's goals as a framework, they allowed the respond*- 
ents to pursue^Jhe issues that were most important to them. 

-From the interview data, the evaluators reached tentative, conclusions^ . 
about what aspects of the program were interesting and valuableto' various 
groups of participants. Then they examined the fffcquenpy of families 1 actual 

0 

participation in the various program .components . Putting the two sets of 
data together they strengthened the^r conclusions. 

- ■ « " • * 

This evaluation had an additional result. It found vhat parents de- f 

V 

scribed as important certain functions that were not part of the program . 
description but that staff were unofficially carrying out. Some of these 
were then elevated to program foals and .purposely c6ntinued. Process studies 
can- often provide information on serendipitous or\unexpected effects. 

As Apling and Bryk (1980) point out, the key to success in process j 
evaluations is the quality- and training of the evaluators. Observations 
and interviewing demand highly complex skills as well as sensitivity to 
the subtleties of situations and personal interaction. Hence they ought 
not to be undertaken without careful planning and supervision, 

61 " 
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VI. SUMMARY , 

> 

In this resource book we have presented ideas on ways in which LEAs - 
might "evaluate their ECT-I programs for parents , < which span a range of pro- 
gram goals. * Our most striking finding is that tests and measures of parent 
"performance or parent competence are few and are generally of low technical 
quality. In fact, few have undergone even minimal examination of Validity 
or reliability. Most LEAs and their evaluation advisors have therefore con- 
centrated on describing^ and* assessing their own programs in. order to frame 
recommendations for local program activities. This task is complicated by 
two factors: . 

• It is difficult ,to describe programs accurately and completely; 

- . 

« There are ethical constraints on evaluation activities. 

In this final chapter, Ve will briefly review, these two factors and then 

* .* 

summarize, the^ advice given us by educators^ and. evaluators in parent programs 

•» ^ . 

across the country. | ... 

Our survey of parent p*ogtrams suggests, that defining the methods of 

* » 
* . ■ * 

parent education programs is an^ especially difficult problem. Indeed, * 
K creators of such programs sometimes have trouble saying just^what their 
program is. There are reasons -why it is difficult to be specific, of course 
First, parent education and its goals are only a minute^ portion of the 
experience of each family/* Many families in bur society are privileged 
by having access to information about successful child rearing, and the 
support and stability within and outside the family' to enable them to use 
that information; but 'there are others) who maytVknow what to do" but-- 
because-o'f personal stress, economic need, or excessive demands from any 
of a number of sources— be simply unable to do it. It is not clear that 
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for these families it is useful to even try to define goals for instructing 
their children. One of our correspondents summarized the complexity of r 
matching goals to families. He said, "There is'no readily identified or 
universally accepted developmental sequence for parents as .there is for . 
children, and since each family brings to the program not one potential 
participant but several, each of them needs a different program." 

Second, although there is consensus that the parents 1 influence on the 
very young child is indeed significant, there really are no normative stand- 

ards for good parenting. The problem is -analogous to that of earlly child- 

i 

hood education in general. Just as it is not yet possible to define with 
precision the skills, underetandings, and behavior that make for a competent, 
sehool-ready child, so it is not possible to define good parenting. To 
circumvent this dilerana, program planners sometimes try to define objectives 
in terms of child competence to be promoted through parent programs. . How- 
ever, even when there is agreement on the desired effect on children, there 
still is no firm evidence of a causal relationship between specific parental 
behavior and any but. the most discrete child behavior. There is, as we 
have pointed out, some knowledge that suggests desirable parental attitudes 
and skills, but even here nothing indicates that there is only one way to. 
do the job; different parental attitudes and behavior might 'lead to similar 
child outcomes. 

Most of the programs that define the objectives of parent participation 
in terms of effects on the child concentrate on language and cognitive de- 
velopment. They provide joint activities for parent and child to develop 
these skills. The problem here, of course, is that the relationship between 
the activity and its effect is usually merely the teacher* s or program 
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developer's^ best guess, based&on little more than personal interpretation 
and intuition.. And of course this approach puts aside for the moment the 
complicated interaction of cognitive, affective, and motivational develop- 
ment in young children 7 - # • 

* *Other programs, .working* on the' premise th^t -the^ process of learning 
. how'to^ le^m-'is ftiore jj^fet ant, than the 'content . of what is learned, remain 

purposely vague about tfha* the 'child is expected to achieve and how -he is 
'to be taught. Parents- are encqj^ged -to a Hew exploration in a prepared 
(safe and.-stimuiatingj- environment. They taught to respond tov explora- 
tory behavior in ways intended to facilitate development ofc the learning 
process. IhcteeS, there 'is some evidence that children reared m a safe 
anti developmental l/ appropriate environment by parents attuned to their 
interests and level of development are more competent in areas of language, 
cpgnition, and social development. The, problem is in defining that match. 
And certainly one cannot exclude the possibility that there is more than 
~<5ne possible match. 

The issues of privacy of families and the rights of parents must also 
* be considered, both in program design and implementation and in evaluation. 
On the program side, parent education activities, particularly home visit 
programs, have been challenged as intrusions into child -rearing, an area 
traditionally reserved to families. Often the program goals' do not match 

♦ 

family values. For example, in some cultures girls are taught to be quiet 
and submissive; suggesting that they should explore and manipulate and 
question may cause conflicts that can be resolved only by compromise— or 
pretense*. 



A second ethical concern has been cogently argued by Schlossman (1978): 
potential "blaming of the victim 11 (Ryan, 1971). Even with intervention, 

V 

poor children may continue to fall below the levels of academic competence 
attained by their more privileged peers. Transferring some responsibility 
for instruction from the school .to the hom'e^carries the risk that poor 
achievement will be blamed on parents. Many programs and evaluation per- 
sonnel are sensitive to the harm this might do, particularly to parents of 
low self-esteem, and emphasize program evaluation, not parent evaluation. 

There is a third ethical issue. Parents may* feel coerced to do things 
that they do not understand or that they disagree with. Although participa- 

w ti l on in parent education (and indeed in all parent involvesnent) is techni- 

r 

cally voluntary, it is unclear how much choice families really exercise in 
deciding whether to participate, and, once enrolled, whether to follow the 
suggestions of- program personnel. There, is abundant evidence that for many 
poor families, the school system represents a powerful- authority, one that 
will greatly affect the lives of their children for many years . These 
families also kitow that often the school personnel's opinions of the parents 

V 

and of parental cooperation and motivation will influence their response 
to, the children. It takes courage to reject participation in a program that 
the school personnel clearly feel will be good for them. This is particu- 
larly so with home visit programs. Once a home visitor enters the family's 
home, it takes enormous courage on the parents 1 part, to challenge or^ overtly 
dismiss the advice given. 

These -ethical issues have implications for program evaluation. If 
indeed parent programs 'are an intrusion into child rearing, is not the 
evaluation of effects on parents a similar intrusion—particularly if it 

€3 
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involves observing behavior in the home or rating it by criteria that involve 
subjective judgments? If parents' ability to insinict </r modify the behavior 
of their child is influenced by more than ^ie information and knowledge they 
have at hand, must not the other factors— personal, economic, and societal 
--also be -taken into account? 'And, finally, how can one tell what happens 
when the assessment .session is over? Does parents; behavior in a testing 
or evaluation setting carry over into their daily behavior, or does it cease 
as soon as the evaluator leaves the scene? 

In summary, several practical pointers emerge from the reports of our 
"respondents. First, it seems important to have a nultifaceted -evaluation 
strategy that is "carefully matched^o the particular program.' Progress 
toward the broad range of goals espouseXby most parent programs can be 
gauged only through different kinds of evaluation techniques.' Parents dif- 
fer' in their need for and ability to make use of program services and are 
therefore candidates for different assessment measures. And of course each 
type of measure carried. with it certain characteristic sources of error. 

"Second, evaluation should focus on tye progr^, not the parents. Pro- 
gram directors continually stressed that the success of parent programs 
depends upon the qualify of the relationship, the sense of trusfand mutual 
purpose, that is developed between parents and stiff. The role of program 
personnel is one of instruction and support for parent and child. If learn- 
ing does not occur, ±f goals are ; not achieved, program staff are adamant 
that the responsibility be clearly placed with the program, not the parents. 
At the same time, since the personnel resources available to evaluate 
parent education programs are- often confined to :usy parents and staff, 
program staff urge evaluation by instruments tha: are short, easy to use, .. 
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and readily analyzed to yield information useful for program improvement. 
Hence a third principle: keep it simple. 

Fourth, parents should be considered as agents rather than merely ob- 
jects of evaluation. More and more parent education programs find it use- 
ful to involve PACs and individual parents at every ste^ in planning, im- 
plementing, and evaluating -their own programs. Starting with a\ioint needs 
assessment, moving on to determining appropriate individual goals and a 
usable system of service delivery, and f inally^assessing the impact of the 

f s ' 

program, they have evolved the concept of education for parents into educa- 
tion with parents. 



-65, 



NOTES ON SOURCES OF FURTHER INFORMATION 
* t. - 

This resource book is only a brief introduction to issues in evalua- 
ting programs for parents of young children. Those interested in\ pursuing 
the topic further may therefore wish to consult additional sources _of in- 
formation. 

**** ^ 
GENERAL SOURCES 

Of the few general references on evaluation of programs for parents, 
one helpful source is in Infant Education: A Guide for Helring Handicapped 
Children in 'the First Three Years -(Caldwell 5 Stednan, 1977". r It treats -: 
early childhood intervention programs in general, assessment of young chil- 
dren and specific programs designed to involve parents and young children 
in educational activities, and includes a fine a:count of tr.e issues in 

d 

evaluating program effectiveness (Chapter IX). \ritten by Caldwell, the 
chapter first discuss'es the purposes of evaluation and then develops a^model 
for formative evaluation of several programs. It k is simply and clearly v 
written and integrates scholarly knowledge with :ommon sense. 

A second helpful source is Handbook for tfeisurenent and Evaluation in 
Early Childhood Education , by Goodwin and Drisccll . (1980) .. This volume 
provides' a wide range of information on' early childhood assessment in general, 
but Chapter, X focuses on evaluation' of parents involvement. While vejjij 
disagree with some minor points made here, overall, it is as good a summary 
of evaluation options as we have found anywhere. > ' 

A third source of information is Teaching, Farents to Teach , edited by 
Lilly and Trohanis (1976). While this volume dees not have a section devoted, 
exclusively to issues of evaluation, it describes nine .outfc landing programs 
in detail and summarizes the procedures.' used in each. Another work, 



■ "66- - „ . 

/ 

Parents and the Day Care Center (1969). by Adair and Eckstein, discusses 
parent participation in terms of parents as actual and potential assets to, 
the program. It, develops a parent growp profile, a community profile, and 
. ' channels of communication for more accurate assessment of parental need. 
The last chapter treats evaluat^n questions. 

In a brief but thoughtful paper presented at the .meeting of the Society 
for Research in Child Development (1979), Levenstp^ discusses issues rele- 
vant to programs for parents , including design, implementation, and evalua- 
tibn, -drawing on 14 years of $hort-term longitudinal and out-of-project 
replication of her Mother-Child Home Program. ^ 

Finally, in connection with early, childhood development programs and 
services, Planning for Action , edited by McFadden (1972), contains an 
"excellent article by Knitzer', which examines thjg ratiortale^or parent in- 
. volvement, argues that parents should have greater control and decision- 
making power, *and offers some ideas how this might be done. , 
PROGRAM EVALUATION 

The systematic use of descriptive data is the topic of Parents^Are 
. ' * " W 

Teachers b*y W. Becker (1971). This volume discusses instructional techniques 

and includes sample forms foj ^recording behavior. While behavior may not 

be the focus -of some progfraiifs, the forms nevertheless suggest the types > 

of things parent education programs might find useful- Giesy, in A Guide 

for Home Visitors (1970), also suggests how to document input'. The main 

' theme of this 'book is home visits and the recordkeeping in programS'that 

♦ - % ' * 

rely upon this method. * * * 

. v 
* . A particularly useful source of information on documenting program 

'implementation comes from the Systems Development Corporation.- This „ 
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- evaluatidh group is currently completing a study of parental involvement 
in four federal education programs. Although the total package of inter,- 
views they use to\ssess the impact of these programs may be far more com- 
prehensive than any single program needs, it is a rich source of ideas. So, 
too, is Partners With Parents , developed by Hewett (1979) to disseminate 
the experience of Home Start personnel. JThis volume contains a chapter on 
management, part of which treats evaluation and long-range planning. More- 
over, the appendix includes examples of the types of evaluation form used. 
OBSERVATION 

Methods for observing parents are similar to those for observing chil- 
dren. Although we can recommend no specific protocols, there are several 
good general discussions of the usefulness of formal observation and pointers 
on how to do it. A particularly good description of the rationale for such 
observations and of methods for gathering and organizing them is Carini's 
monograph Observation and Description: An Alternative Methodo logy for the 
. Investigation. of Human Phenomena (1975). Another good discussion is found 
in Hutt and Hutt, Direct Observation and Measurement of Behavior (1970),. 

Goodwin and Driscoll, "tfi the Handbook for Measurement and Evaluation in 
/ 

■ Early Childhood Education (1980), also include a chapter on observation 
' practices, and point out that observation is most useful as a complement 
to other means of evaluation. In simple terms, the chapter outlines the 
importance of observational measurement, describes formal and informal 
approaches, and recounts the advantages and disadvantages of observation. 

Several collections of observation systems are available. Most 
systems focus on 'child behavior, "but some deal with parent -~thild inter- 
action and may provide ideas for instrument development. Among -the better 
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• collections are Measures of Maturation, An Anthology of Early Ghildhood 
Observation Instruments ' (Boyer et al., 1973), and Studying Behavior in 
Natural Settings (Brandt, 1972). 
LINKING PROGRAM TO OUTCOME 

Among the guides and manuals for conducting self-studies are those 
produced by the National Study of School Evaluation (1973) and the National t 
Associatibn of Secondary School Principals (Georgisdes, 197,8). These were 
not written for use with parents and so must be adapt ed^s omewhat , but the 
id&as are .sound. 

Information on qualitative evaluations \s included in several sources. 

Perhaps the clearest presentation is found in Getting the Facts by Murphy 

(1980). This book, intended for ^valuators considering investigative re- 

search, is readily adaptable to programs wishing to train parents for some 

types of interviewing. A. second source of iifrffrrnation is Interv^eftioag: Its 

Principles and Methods by Garrett (1972). Designed by the Family^rvice 

Association of America as a bsfsic test for teaching interviewing to pro- • 

fessionals and paraprcf essionals , it can easily be used also witTi parents. 

OTHER SOURCES OF INFORMATION a * 

Several additional sources that provide useful information should be 
t 

noted. The Educational Resources Information Center (ERIC Network) is one 
of the most valuable. ERIC encompasses a computerizes information retrieval 
system covering a wide range of published and unpublished material.. The 
system is described in NIE's publication ERIC: A Profile , and suggestions 
on how to use the system, are provided in Brown, Sitts, and Yarborough (1975) 
and Simmons (1975).. ERIC has 16 clearinghouses that col feet, evaluate, and 
distribute in'formation on a particular t'opic area. Three of these that are 4 
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relevant to programs for parents are listed below, with notes on the. scope 
of areas they cover. ^ 

ERIC Clearinghouse on the Disadvantaged 

Columbia University Teachers College . 

Box 40 * :• ' . 

525 W. 120th Street : 

New York, New York 10027 : 

Telephone: (212) . 678-3780 ^ 

Effects of disadvantaged experiences and' environments, from birth onward; 
academic, intellectual, and social performance of disadvantaged children 
and youth from grade 3 through college entrance; programs- and practices that 
provide learning experiences designed to compensate* for special problems of 
disadvantaged; issues, programs, and practices related (1) ,to economic and— 
thenic discrimination, segregation, desegregation, and integration in educa- 
tion; and (2) to redressing the curriculum imbalance m the treatment ot 
ethnic minority groups. .« «*> 

ERIC Clearinghouse on Early Childhood Education 

University of Illinois 

College of Education 

805 W. Pennsylvania Avenue 

Urbana, Illinois 61801 

Telephone: (217) 333-1386 

Prenatal factors, parental behavior; the physical, psychological, social, 
educa-tional, and cultural development of children from birth through the 
primary grades; educational 'theory, research, and practice: related to. the 
development of young children. - . 

ERIC Clearinghouse on Tests, Measurement , and Evaluation 

Educational Testing .Service § . , 

Princeton, New Jersey 08540 « 

Telephone.: (609) 921-9000 ext. 2182 ( ■ '• 

Tests and other measurement devices; evaluation procedures and techniques; 
application of tests, measurement; or evaluation in educational^) roj ects 
of programs. ( 

More general information on the ERIC system and its other clearinghouses 

is available from: 

Educational Resources Information Center 
(Central ERIC) 

National Institute of Education 
Washington, D.C. 20208 

Telephone: (202) 254-5040 , • 
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TEST COLLECTION 

The Educational Testing Service administers the Head Start Test Col- 
lection, which was established to provide information about: assessment 
instruments for* children from birth to nine years of age. Qualified persons 
forking in early childhood education'h^ve access to the collection in person 
or via mail or .phone inquiries. The 'collection also publishes' bibliographies 
on assessment topics relevant to programs for parents. These include: 
t Measures of Child-Rearing Practices and Related Attitudes 
, t Children's Attitudes toward Parents * . 

{ t Measures Pertaining to Environments. 

For copies of these bibliographies or further information on the Head Start 
Test Collection, write to: 

Head Start Test Collection 

Educational Testing Service * 
Princeton, N.J. 08540 

The Title I Technical. Assistance Centers serving 4 the ten regional areas 

.of the United States are also sources of information on educational assess- 
« 

ment, particularly with respect to Title I evalaation. 

- Region I : Connecticut, Maine, Massachusetts, New Hampshire, 
Rhode Island, ancf Vermont 

j . + 

-RMC Research Corporation 
•400 F^fayette Road • 
-Hampton, N.'H. 03842 
Telephone: (605) 436*-5385 
926-8888 

Region II : New York, New Jersey, Puerto Rico, and the Virgin 
Virgin Islands ? 

-Educational Testing Service 
Princeton, N.J. 08540 
Telephone: (609) 734-5117 
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Region III : Delaware, Maryland, Pennsylvania, Virginia, 
West Virginia, and the District of Columbia 

-National Testing Service 
2634 Chapel Hill Blvd. 
Durham, N.C. 27707 
Telephone: (919) 493-3451 
{ (800) 334-0077 

Region IV : Alabama, Florida*, Georgia, Kentucky, Mississippi, 
North Carolina, South Carolina, and Tennessee^ 



-Educational Testing Service 
Southern Regional Office 
250 Piedmont Avenue 

Suite 2020 . . , 

Atlanta, Georgia 3C526 
■ * Telephone: (404) 324-4501 

if 

Region V : Illinois, Indiana, Michigan, Minnesota, \ 

Ohio, and Wisconsin 

-Educational Testing Ser\ice 
1 American Plaza 
Evanston, Illinois 60201 
Telephone: (312) S59-7700 

Region VI : . Arkansas, Louisiana, New Mexico, Oklahoma, 
and Texas 

' -Powell Associates 

3724 Jefferson n ^ 

Suite 205 " * ' "~ 

Austin, Texas 78v31 

- Telephone: (512) -33-7288 . 

(800) 331-5239 

Region VII : Iowa, Kansas, Missouri, and Nebraska 

* .-American Institutes for Research 
P.O. 8f>x 1113 ' — 

Palo Alto, CA 94302 \ 
Telephone: (415) -94-0224 ' 

Reg ions VIII , Colorado-,- Montana North Dakota, South Dakota, 
IX and X- Utah, and Wyoming (Re-gion VIII); Arizona, 

. California, Hawaii, Nevada, Guam, Trust Territory 

of the Pacific Islands, and American Samoa 
(Region IX); and Alaska, .Idaho, Oregon, and 
, Washington (Region X) 

-Northwest Regional Laboratory 
710 S.W. Second Avenue 
Portland, Oregon 9"2a4 
Telephone: (503) 248-6S53 
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APPENDIX 

INSTRUMENTS TO MEASURE PARENT EDUCATION 



Th$ following instruments are reviewed here:* 



Instrument 

Cognitive Home Environment Scale 

High/Scope Parent-Child Interaction 
Checklist and Ratings 

Hone Observation for Measurement 
of the Environment* 

Mutual Problem -Solving Task 

Parent, as a Teacher Inventory 
and Profile 

Parental Attitude Checklist 
ParentaL Behavior Inventory . 



Author (s) 

N. Radin and D. Weikart 



B. Caldwell et al 

A.S. Epstein et al . 

R.D. Strom and H.B. Slaughte: 

R.D. Boyd and K.A. Stauber 
R.D. Boyd and K.A. Stauber 



An additional instrument, the Home Base Survey and Parent Survey, adapted 
from the Follow Through Parent Education Model, was also reviewed in 
earlier draft of this resource book. Unfortunately, the progracr\in which 
it was developed has been discontinued and the survey is no longer avail- 
able. 

* • 

<9 
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Cognitive -Home Environment Scale (CHES) 
paternal aftd paternal forms available) 



AUTHOR 



Norma Radin and David Weikart 



DISTRIBUTION SOURCE 



School of Social Work 
University of Michigan 
Ann, Arbor, Michigan 48109 



also available from 
ETS Test Collection 
Tests in Microfiche 
#007267 



DATE OF DEVELOPMENT 



Circa 1966 



COPYRIGHT DATES 



Material not copyrighted 



MATER I AL£*A\D COSTS 



Material available without^charge 



PURPOSE 



WHO IS EVALUATED 
(Child or Parent) 



To measure the degree o^ cognitive stimulation in the home 
by probing attitudes, home activities, and possessions 
related to education 



Parent . (mother ,or father) * 



SPECIAL fEATURES.OF 
TARGET POPULATION ■ 



The dHES was designed for use with parents of disadvantaged 
children in* a compensatory pr*escht>ol program. 



■I 



FORMAT 



The CHES is a semi ^structured questionnaire, adapted from 
the Wolf Environmental Process' Variable Scale. It contains 
25 items scored on a 7-point rating scale." : t 



HOW ADMINISTERED 
(Including Hoae)-* ' 



♦Interviewer ctiSes parent's Answers to questionnaire 



fcUO ADMINISTERS 



.Interviewer, such as a. teacher or external evaluator 
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TRAINING 
NECESSARY FOR 
ADMINISTRATION 



. ,-75- 

The CHES is administered entirely as a questionnaire, asks 
specific questions about parent and child behavior, and 
does not involve rating general characteristics or observing 
behaviour* Hence, interviewing skills are necessary for 
administration, but no formal training with the instrument is 
required. , 



TIME TO ADMINISTER 



30 minutes 



CONTENT: 



SUBTESTS 



The variables examined include parental attitudes toward cliild 
and learning, home activities, possessions. The questions 
cover such areas as the availability of educational and craft 
items to the ctiild, the grades the parent wants and 
expects the child to receive ir. school, the kinds of actitiv- 
ities the child shares with the rest of the family, and the 
parent ! s plans for the child's future education. 



GOALS FOR WHICH 
INSTRUMENT IS 
APPROPRIATE 



(Check Where 
* * Applicable) 



9 

ERLC 



Focus Toward Cnild: * 

• Cl) 7~x7 Change in Knowledge 
C2) /T7 -Change in Attitude 

(3) / X / Change in Function * 

Focus Toward School Services and Personnel: 

(4) / / Change in Knowledge - - & * 

(5) / / Change in Attitude 

* (6) / / Change in Function 

Focus Toward Personal Needs of Parents as Adults: 

(7) / / Change in Knowledj 

(8) / / Change in Attitude 

(9) L I ^ l3Sl S> e in^Functim 
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RELATIONSHIP BETWEEN 
PARENT CHANGE AND 
CHILD CHANGE 



The CHES is based on the assumption that changes in parental 
attitudes and child rearing practices may enhance the 
stimulation of the home environment and, in turn, foster 
the cognitive competence of the child. 



p. 



FORMAT FOR 
PRESENTATION OF 
RESULTS 



S 



The results are primarily presented as factor scores. 
Analysis using scores on individual items would also consti- 
tute an appropriate use of this instrument. Computing a 
total CHES score is not recommended as it primarily reflects 
Factor I, Educational Materials in the Home. 



INFORMATION 
AVAILABLE FOR 
ADMINISTRATION 
AND USE 



See Coding Manual and Final Report (N. Radin aihj H. Sonquist, 
"Ypsilanti Public Schools /8ale Preschool Program," Final 
Report , March 1968) . 



TECHNICAL QUALITY: 

STANDARDIZATION 
RELIABILITY AND 
" VALIDITY 



Reliability : 

A reliability test (Radin and Sonquist, 1968) yielded agree- 
ment between two independent scorers on 91% of the items. In 
addition, interobserver reliability on the CHES scores was 
94.9% (Epstein' and Radin, 1974). 

Validity : 

The construct validity has been suggested by a number of 
studies (Epstein and Radin, 1974). 

Factor analyses yielded: Educational Materials in the Home, 
Grades Expected, Future Expectations, Educationally-Oriented 
Activities, and Direct Teaching. 

There has been no other technical work to date'. 



t 
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CULTURAL- 
CONSIDERATIONS 



Inasmuch as it emphasizes questions about birthday presents, 
library cards, and encyclopedias in the home, the CHES appears 
to be biased toward middle-class values. However, it has been 
used in several studies with lower-class families, and the 
researchers have observed that "significant and predictable 
social class differences emerged on four of the five factors, 
indicating that the CHES is sensitive to the fact that the - 
degree of cognitive stimulation in the home diminishes with 
decreases -in social class status. 1 ' (Radin and Epstein, 1975) 

\ 



POTENTIAL 
USES 



The CHES has been used in a range 'of intervention studies 
in conjunction with other instruments: (1) to evaluate 
maternal involvement in a compensatory preschool program; 4 
(2) to measure pre- and post-intervention changes in child- 
rearing attitudes and, practices of lower-class mothers of pre- 
school children; (3) to examine the relationship of paternal 
responses to a child- rearing questionnaire with observed 
paternal behavior and measures of child competence. The 
developers believe the CHES could be useful as a before and 
after measure to determine the impact of a program' directed 
at enhancing parents 1 perceptions of themselves as teachers * 
and in predicting the cognitive competence of children. 



RE r ERE\CES 



i 



Related Research : 

Epstein, A.S. § Radin, N. , "Paternal Questionnaire Data and 

the Preschool Child,' 1 University of Michigan, 1975. 
Radin, N., "Child Rearing Antecedents of Cognitive Development 

in Lower-Class Preschool Children. M Doctoral dissertation. 

'University of Michigan, 1969a. (University Microfilms, 1970, 

No.. 70-4170) 

Radin, N. , "The Impact of a Kindergarten Home Counseling 

Program, M Exceptional Children , 1969b, 36, 251-256. 
Radin, N. , 'Three Degrees of Maternal Involvement in a 

Preschool Program: Impact on Mothers and Children," Child 

Development , 1972, 43, 1355-1364. 
Radin> N. § Epstein, A.S., "Observed Paternal Behavior with 

Preschool Children," University of Michigan, Final Report, 

April 1975. 

Wittes, G. § Radin, N. , M Two Approaches to Group Work With 
Parents in a Compensatory Preschool Program, 11 Social Work , 
16, 1, January 1971, pp. 4,2-50. 

Reviews: 



Johnson,- Orval G. , Tests and Measurements in^Child Development: 
Handbook II , Volume 2, San Francisco: Jossey-Bass Publishers, 
1976, p. 757-759. 



COMNEXTS 



/ 
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This is one of the few, measures that p^i 
father-child interaction. 



Dorts to assess 



\ 
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TITLE 


High/Scope Parent-Child Iftteraction Checklist . • 
and Ratings (PCIC) 




AUTHOR . • . 


> * 


• 


"> - 

DISTRIBUTION SOURCE 


High/Scope Educational Research Foundation 
600>North River Street 
Ypsilanti, Michigan 48197 


DATE OF DEVE LOPMENT 


1977 


COPYRIGHT DATES *\ 


Material not copyrighted 


MATERIALS -AND COSTS J 


Manual and materials available from High/Scope,- In lieu 
of fees, users are" asked to share their findings. 


PURPOSE 

■J 


To measure the dimensions of parent-child interaction during 
routine caregiving activities 

\ 


KHO IS EVALUATED 
(Cnild or Parent) 


Parents anc children * 

9 


SPECIAL FEATURES OF 
TARGET POPULATION 


The instrument was originally developed for 'research in 

parent-child interaction with parents of infants and toddlers, 

* * * 


FORMAT 


Parents and children arte videotaped , at e home during a feeding 
or diapering situation, then the taped interactions are coded 
tt 10-second intervals according to several checklist cate- 
gories. The observer also rates the incidence of several 
more general behaviors from low to high on a 5-point £cale. 


HOW ADMINISTERED 
(Including Home) 

* 


Parents and children are videotaped at home.^ 
•> 


J--MO ADMINISTERS 

IC 


Observer, who in the original research was a graduate 'student 
assistant 

^- J7n 
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TRAINING 
NECESSARY FOR 
AIMINISTRATION 



A moderate amount of training is necessary to develop reliable 
observers familiar with the coding categories. 



TI>E TO. ADMINISTER 



Approximately 15 minutes 



CONTENT: 



SUBTESTS 



In addition to coding the Checklist categories of .physical 
and verbal interactions, affect, and patterns of initiation- 
response, observers are asked to rate several more general 
qualities of the same activity, such as the overall comfort 
and safety of the environment, stimulation in the environment, 
effectiveness of parent as problem-solver. \ 



GOALS FOR WHICH 
INSTRUMENT IS 
APPROPRIATE 



(Check irtiere 
Applicable) 




ERIC 



Focus Toward Child: 

CO / X/ Change in Knowledge 

• ** 
C2) fW Change in Attitude 

C5) / X/ v Change in Function J* 

t 

Focus Toward ScJwffel Services 'and Personnel: 
J I Change in Knowledge 
/ I Change in Attitude 

(6) / / Cnange in Function 

Focus Toward Personal Need£_of Parents as Adults 

(7) / / Change in Knowledge • v 

(8) / / .Change in Attitude 
^^9) / / Change in Function s 
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RELATIONSHIP BETWEEN 
PARENT CHANGE AND 
CHILD CHANGE ' * 




T. 



v 



Use of the PCIC is blsed on the; assumption that tj^e categories 
reflect dimensions 01 parent-child interaction /^hich are sal- 
ient in children's growth- as learners. • 



j$CIC observation sheet and PCI rating sheet for individual 



FORMAT FOR 
PRESENTATION OF 
RESULTS • 



results 



•9 



INFORMATION 
AVAILABLE FOR - 
ADMINISTRATION 
AND USE 



Manual on administration arJd scoring available fron High/Scope 



X 



Reliability: For tHfe Checklist, inter- observer reliability, 

— — — : r> . . i r *7 /* f- o • i n r\t 



TECHNICAL QUALITY: 



f 



STANDARDIZATION 
RELIABILITY AND 
VALIDITY 



defined as percentage of agreement, ranged from 76. 5%' to 100%, 
with a» mean- overall sc?le of 88.4%.. For the Re.tirgs, inter- 
observer reliability ranged fiom. 80% to 100%, wjl^ an average 
across all scales of 91.4%. * : 

Validity : T)jLere nas been no otner technical work to date. 



:RIC_ 



\ 



Si' 



> - 
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CULTU3AL- v . 
CONS IDEATION'S 



The^ authors intended to make the instrument as universal as 
possible^ 



\ 



% '1 



./ote^tial 
uses , 



The instrument could be used as a pre- and post-measure' to 
document changes in parents 1 style of interaction. 




REFERENCES 



Related research 



Epstein, Ann S. S-Evanr, Judith, "Parent-Child Interaction 
and Children's Learning," in The High/Scopr, Report ,. No, 4^ 
1979, pp. 39-44." ^ 



Reviews 



No published reviews .available to. date 



\ 



C0M?E.7S 



o ■ 
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High/Scope has developed several other means of assessing 
parent education that may be of potential interest: 



may 

" Mi.tuaT'Problem- Solving Task 
Infant Education Interview 



pel 
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TITLE 
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Home Base Survey and Parent Survey 



AUTHOR 



Adapted from the Follow Through Parent Education Models 
Home Environment Review 



DISTRIBUTION SOURCE 



Project Home Base 
Yakima Public Schools 
104 N. 4th "Ave-.*" 
Yakima, Washington ' 9*902 



0ATE OF DEVELOftfENT^ \p 



1975 



COPYRIGHT DAT^S^ 



Material not copyrighted 



MATERIALS TtflD COSTS 



Materials available without chargfe 



PURPOSE 



To, measure the success of the program in supporting and 
enhancing the •mother's parenting/ teaching behavior 



4 



WHO IS EVALUATED 
(Child qjc Parent) 



parent 



SPECIAL FEATURES OF 
TARGET POPULATION 



These surveys were designed for use with children from low- 
income homes- \ ' 



FORMAT 



iWs- of bri* 



The surveys consi-st of a series- of brilf questions which are 
answered on a scale of strongly agree to strongly disagree, 
plus a series of open-ended questions soliciting parent j 
comments., t » 



HOW r ADMINISTERED 
(Including H^me) 



JWO" ADMINISTERS" 

ERIC : 




The interviewer records parents 1 answers to the questionnaire 
and make's some^more globaj observations a^out stimulation 
available in the home. 



Paraprofessional parent educator in the home 

& \ 
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TRAINING 
NECESSARY FOR 
ADMINISTRATION 



As part of their general duties, paraprofessional parent 
educators receive pre- and inservice training- No . 
specialized training is required to administer the surveys, 



\ 



TIME TO ADMINISTER 



30 minutes 



6\ 



CONTENT: 



SUBTESTS 



The Home Base Survey collects infornation on child develop- 
ment, schofiBjwrelated activities and teaching. In the 
parent survey, parents .are asked how their attitudes have 
changed, how the child 1 s behavior has changed, perception 
"of self as teacher, learning stimuli available in the 
home environment. * % 



r 



GOALS^FOR KHICH 
iXSTPSJMENT JS 
^APPROPRIATE 



(Cljeck .Where 
Applicable) 



V 



/ERIC 



Focus Toward Child: > 
[1)7X / Change in Knowledge 
C2) fT7 \ Change 'in' Attitude 
C5) VxT] Change in Function 

* t 

^Focus Toward School Services and Personnel 

C4) / ) Change in Knowledge 

(.5) / I Change in Attitude ' . ' 

((,) I I Change in Function . 

. ' ■ . \ 

Focus Toward Personal Needs ofvParents as Adults: 

*— • x / 

"(7) / / Ghange in Knowledge * 

(8)- / / 4 Ch£nge in Attitude « ( 

. j \, - 

^9) / / Change an Function, 



RELATIONSHIP BETWEEN 
PARENT 'CHANGE AND 
CHILD CHANGE ' ' 



One premise of this program is that parent change will be ^ 
reflected by child change. Hence, the program has set a 
concrete objective: children who have been exposed to the home 
intervention/parent education activities will be able to, per- 
form better on the Preschool Inventory (Educational Testing 
Service, Princeton, N.J., 19.67) with statistical significance 
set at the\05 level 'of confidence. In addition, children 
will perform 92.5% of the tasks taught them by. their mothers, 
measured by means of an interview and observation instrument 
completed by the parent educator^ following each home^ visit. 



FORMAT FOR 
PRESENTATION 7 OF 
RESULTS 



INFORMATION 
AVAILABLE FOR 
ADMINISTRATION 
AND USE 



The Home Base Survey is used primarily as an initial screening 
instrument but could be compared post-intervention to document 
changes. The Parent Survey is compiled and presented as 
aggregate percentages. • • 



None available. , 



TECHNICAL QUALITY: 

STANDARDIZATION 
RELIABILITY AND 
VALIDITY ' 



No technical work, has been done to crate. 



POTENTIAL 
USES 



These surveys have been used pre- and post-intervention in 
conjunction with direct 'measures of child change, sucfiT^as 
Caldwell ! s Preschool Inventory and the Alpem § Boll 
Developmental Profile. 



Rr|Er£N:CES 



Related research : * 
No additional citations are available. 



Reviews : 



No publish^ reviews available to date 



COMMENTS 



These^5«rveys , aimed at documenting parent satisfaction and 
home stimulation, ark easy to administer, and to respond to, 
and appear to provide useful information. Its developers, t 
however, ^are not completely satisfied with thent anc^ have re- 
vised them several times, teeling unaoie to fi-nd a standard- 
ized instrument that can measure program impact. 

r\ , ' * 
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TITLE 



AUTHOR 



DISTRIBUTION SOURCE 



DATE OF DEVELOPMENT 



COPYRIGHT DATES 



Tfc 

MATERIALS AND COSTS 



' -86- 

Home Observation for Measurement of the- Environment 
Infant Version (ages 0-3) . * 
Preschool Version Cages 3-6) 



Infant ^Version: B. Caldwell, J. Heider, and B. Kaplan 
(1966^version) ; B. Caldwell, R. Bradley, and R. Elardo 
(1972 -Version) • *i 

Preschool Version: B~ Caldwel*! and R. Bradley + 



Center for Child Development and Education 
University of Arkansas at Little Rock 
814. Shernan 

Little Rock, Arkansas 72202 . 



Infant Version: 1966, revised in 1972 
Preschool Version: 196*8, revised in 1978 



1978 



Specimen Set - $3.00 



\ ?u£?os! 



j 

jtVHO IS EVALUATED 
] (Cnild or Parent) 



To measure the quality' ahd quantity of stimulation found in 
the early home environment by sailing aspects of the 
social, emotional, and cognitive support available to a 
young child within his or hYr home 

Intende,d primarily as a screening instrument • 



Parent and child interacting in home 



\ 



SPECIAL "FEATURES OF 
TARGET POPULATION 



FORMAT ' 



This instrument was designed for use with children at" risk of 
developmental dflay due to environmental deprivation. 



Infant: Consists 3?f a checklist of 45 items or statements 
(originally 72 items) which the interviewer scores 
as yes or no t " ' „ • 

Preschool: Consists of a checklist of 55 itenis (originally 
. 80 items/ which the interviewer scores as yes or no 

4^ 



HOW ADMINISTERED 
(Including Home) 



&"~> ADMIN IS 



ERIC 




Both versions are completed by a single external evalu^tor 
through interviews and observation with both the parent 
and dhild present *in thfe home. * 



Interviewer 
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TRAINING - . 
NECESSARY FOR 
ADMINISTRATION 



interviewers are not required to have professional background, 
but practice in the use of this instrument is necessary for 
valid data collection because the instrument is scored on a 
yes/no*basis and does not involve gradations within an item. 
Training to administer HOME can 'be fairly brief. 



TI.ME TO ADMINISTER 



CONTEST : 



SU3 TESTS 



/' 



Approximately one hour 



The selection of items was guided by empirical evidence of 
the importance of certain types of , experience for .nourishing 
the behavioral development of the child. Items were chosgn 
to represent these areas: frequency and stability of adult 
tontact; amount of developmental and vocal stimulation; need 
gratification; emotional climate; avoidance of restriction 
on motor and exploratory behavior; Available play materials; 
and home characteristics indicative of parental concern with 
achievement. For example, observer note^ mother's use -of 
physical punishment; whether child is encoura-ged tc^leam 
colors or numbers; how mother expresses warmth to fRild; 
whether home appears safe and reasonably clean; what types 
of books and toys are available. 



"jL 



Focus Toward Child: 



GOALS FOR WHICH 
INSTRUMENT IS 
APPROPRIATE 

if 



(Check Where * 
Applicable) 



0) / X / £h2-ag e in Knowledge 



C2) / x / .Change in Attitude 



ERIC- 



C5) /x / <Change in Function , K \ « + 

< * 

Focus Toward School Services and' Personnel ; 

^2 -' ■ p * . • 

(4) / / f Change in Knowledge • *■ 

9 

£5} / / Change in Attitude 

(6) / / Change in Function • . . ^ 

* » 

Focus Toward. Personal Needs of Parents as Adults:* 

(7) / / 'Change 'in Knowledge ' v 

* (g) / / Change in Attitude x 

* (9) /' J Chs3ger-xn Function. 
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RELATIONSHIP BETWEEN m 
PARENT CHANGE AND * 
CHILD CHANGE 

[ 
i 

i 


Use of this instrument is based on the ass^Gnption that changes 
in parent knowledge and understanding will ultimately jlead 
to, changes in the child's "developmental status. It' is impor- « 
tant to note that the instrument itself does not directly 
measure child changes, and 'is therefore often used in conjunc- 
tion with other measures of child change, * 


i 

; FORMAT FOR 

! PRESENTATION OF 

i RESULTS 


Th£ final product* may be reported as a single total 
"numerical score, or results may be given as factor scores. 


I INFORMATION * 
i AVAILABLE FOR 
! ADMINISTRATION 
; AND USE 


Cpp "Tn<;tnirt i nn<; *Pdt Administrate on !l ivro 88-115 in Homf* 
Observation for Measurement of the Environment, 


Bettye M, Caldwell, 1978. 


', ^ 
j TECHNICAL QUALITY: 

t 

> STANDARDIZATION 
: - RELIABILITY AND 
• VALIDITY - 

i 4 * 

h • ^> 
!< 

i 

1 - • 
i 
! 
1 

I 
• 

\ ' 

» V ■ 

1 /» 

t \ 

f 

1 v 

I 
* 

! ^ 
i 

9 ' \ 


fsycho^S^ric characteristics of 'the HOME have been examined 
extensiv^W, based on data collected on families in Little Rock, 
Arkansas (IiK^r.t version - 174 families; Preschool version - 
258 families) s^^the insp?timent has been through a number of, 
standardization procedures* 

Reliability: Infant version--A Kuder-Richardson 20 coefficient 
was computed at r=.89 for the total scale. For the subscales, 
reliability ranged from very lev to very high, e.g., r=.44 
(subscale III, Organization of Physical and Temporal Environ- 
ment) to r=.89 (subscale VI, Opportunities for Variety in 
Daily Stimulation). Preschool version: A Kuder-Richardson 
20 coefficient was computed at r=.93 for the total scale., For 
the Subscales, reliability ranged from very low to very high, 
e.g., r=.53 (Subscale VI, Modeling and Encouragement of Social 
*iaturity) to r=.85 (Subscale II, Physical Environment: Safe, 
Clean, and Conducive to Development) . 

Validity: Infant version--7he authors report high correlations 
with IQ (up to .85) and language (up to .64,). Moderate cor- 
relations weje reported with" SES. Has been reported to discri- 
minate between high risk and normal homes. Preschool version-- 
Author^ report high correlations with IQ (up to .64). Moderate 
correlations with later achievement (up tta .55) and with SES 
were also reported. 

Factor analysis of the infant version yielded: 1. emotional anc 


verbal responsivity of the mother; 2. avoidance of restriction 
and punisnment ; 3 . org am *.ac iO:. 01 cne pnys lcai ana Lempordi 
environment;* 4. provision of appropriate play materials; 5. 
maternal involvement with child; 6. opportunities for variety — 
' in daily stimulation. • ' . ( i 
Factor analysis of the preschool version resulted in: • 


1. stimulation through toys, games, and materials; 2. language 
stimulation; 3. physical environment; 4. pride, affection, and 
warmth; 5. stinulation of academic behavior; 6. modeling and 
encouraging of social maturity; 8. variety of stimulation; 
9. physical punishment. • ^ / • 
.1 1 1 . ( 
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CULTURAL 
CONSIDERATIONS 



POTENTIAL* 
USES 



The authors are sensitive to issues of 
may occur in a measure of the "quality 
(1978) states that "every attempt was 
that represent stimulation and support 
mean money, social status, or education 
standpoint of the Inventory, a trip to 
as much credit as~a trip to the art mtis 
likely to be interesting, informative, 
young child.'' 



discrimination which 
of life." Caldwell 
made to include items 
but do not necessarily 
• Thfis, from the 
the grocery store gets 
eum, in that both are 
and stimulating to the 



The infant version of HOME has been used in a variety of 
research, including studies of malnutrition, language* develop- 
ment, cognitive develrpment, school competence, high risk 
families, and program evaluation. While the actual extent of 
use is difficult to gi-ge, it is known to be quite large, 
with the instruments having been translated into several for- 
eign languages for use in other countries. f > 



REFERENCES * 



ERLC 



Related Research : 

Bradley, R., S Caldwell, B, Early home environment and changes 
in mental test, performance in children from 6 to 36 months. 
Developmental Psychol :gy , t9~76, 12^ 93-97. 

Bradley, R.j § Caldwell. B. Home observation fox measurement 



)f ^ 

%*4 



K validation study of screening ; 
Journal of Mental Deficiency, 1977. 



etficiency . Am eric 
81(5), 417-420. 
Caldwell, B. Home observation fox measurement of the 

environment , 1978. 
Caldwell, B., Elardc, ?., & Dlardo, R, "The Longitudinal 
Observation* and Intervention Study: A Preliminary Report." 
Presented at the meeting of the Southeastern Conference on 
Research in Child CevTlopzent, Williamsburg, Virginia, 
April, 1972. \ 
Caldwell, B,, Heider, -\ , 5 Kaplan, B, "The Inventory of' 
Home Stimulation. " riper presented at the meeting of -the 
American Psychological Association, September 1966. 
Elardo, R. , -Bradley, , &£aldwell, B. <p ^Jhe relation of 
infants 1 home envirorr^nts to mental'test performance frofli 
6 to 36 months*; A icr.gitudinal analysis. Gfild Development , 
197S, 46, 71-76. — — — _ 

Reviews : ,. 

Johnson", Orval G., Tersrs and Measurements in Child Develop- 
ment. Han^hnnV l\ t \ rlume 2 ^San Francisco; Jflssey-Bass 

, Publishers, 1976, pp. 796-799... 

Johnson, Terri Z., Ann: tat ed Directory of Environmental 
Assessment Instruments , Individualized Data 5ase, University 

'Research Group at Pacific State Hospital, Pomona, Calif- 
ornia, September 19J7S. ' — 
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TITLE 


Mutual Problem-Solving Task (MPST) 


AUTHOR 


Anne S. Epstein, Pam Schwartz, Judith Meece 

' • ) 


DISTRIBUTION SOURCE 


High/Scope -Educational Research Foundation 
♦ 600 North River Street 
Ypsilanti,. Michigan 48197 . " 


DATE 07 DEVELOPMENT 


1975 


COPYRIGHT- DATES ' 


Material not copyrighted 


t 

MATERIALS AND COSTS 


A manual on development and administration, including 
definitions of coding categories and code sheets, is 
available from High/Scope^. In lieu of fees, users are 
requested to share their Findings. 


PURPOSE * 

"t > 

■ s 


To ^xamine the variety of mother-phi Id interaction and 
teaching styles used in accomplishing a particular task 


WHO IS EVALUATED 
(Child or Parent) 


Parent and child in home >v 

V , ' . \. 


SPECIAL FEATURES OF 
TARGET POPULATION * 


Th p ln^tn impn 1" ^ fiSH oitia 1 1 v H pvp 1 nnprl a <; ? *f n 1 1 nw- i in m p r — 

sure of mother-child fnteractior in 53 work:ng-£lass families 

w} o participated in ( the 1968-70 Ypsilant i-Carnegie Infar.t* 

Education Project. 

% 


* 

c 

FORMAT t f 
« 


The MPST involves systematically observing mother-child 

intPTflrf inn fiiiT"intrf a rnoVi p-Hflk"i x\o arti vi fv f*onV "i p — nfllr*f n o 

1 11 L Cl uL L 1U11 UU1 111^ CL LUUM C UdAlllg CIL LI V A. J • vUUMC UuMllt 

was designed to be a standard situation analogous to hone * 
visit 'teaching 1 situations'in the infant education program. 
Observers introduce themselves tq both the Esther *ajid the 
rhiiH anH fie-l4A^or a set of specified introductory remarks , j 


ER 




outlining the research procedureT m + *• / >^ 


H(W ADMINISTERED 
(Including Home) . 

* 


f¥h^ interviewer observes mother-child interactions at home 
during prescribed cookie-baking activity, c:des behavior at 
10-secbnd and- 5-minute intervals, fills out .a racing sca*le, 
and conducts an interview consisting of open-ended questions. 


WHO* ADMINISTERS" ' . 

JC 


Interviewer -- in the original research, these were graduate 
student assistants -- who are trained in using t)ae inst^u- 

. --te — . — 
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TRAINING 
NECESSARY FOR 
ADMINISTRATION 



TIME TO ADMINISTER 



CONTENT: 



In the original research, the explicit instructions for the in- 
terviewers included about 40 hrs t of training in administering 
4nd coding. Because administration is done as live observation, 
training is relatively important, but pan be c^pne locally. A 
complicated series' of categories must be mastered to code- the 
style and content of both mother's and child's behavior. The 
major coding groups, each with several categories, are: affect, 
task involvement, requests for assistance, and responses 'giving 
assistance. In addition, the behaviors are categorized as * 
verbal and/or physical, supportive or restrictive, and xon- 
v^jeijt or divergent.. 



30 to 60 minutes 



SUBTESTS 



The MPST measures/several aspects of a mother's teaching style 
and the mutual inflOence between mothers and children. Four 
separate measures are-included: Interaction --Cate g o ry -System, — 
Content Checklist, Rating Scale, and Maternal Interview. ' It 
focuses on positive and negative verbal communication, effec- 
tiveness of communication, patterns of initiation-response and 
levels of activity-passivity of mother and child. For instance 
the Maternal Interview asks about the kinds of activities which 
the mother and child share, the- appropriateness of, maternal 
expectations and behavior, and the mother's rareness of how . 
she interacts with her child. * 



GOALS FOR WHICH 
INSTRUMENT IS 
APPROPRIATE 



>(Che£k Where 
Applicable) 



eric 



Focus Toward Child: # 
Cl) / X / Change in Knowledge 
C2) 7T7 Change. in Attitude 
C3) / X / Change in Function 



v 



Focus- Toward School Services and Personnel: 
. C4) / / Change in Knowledge 
£5) / / Change in Attitude* 



(6) / / Change in Function ; 

Focu? Toward Personal Needs of Parents as Adults 
£7) / y Change in, Knowledge ' . 

(8) / / Change in Attitude • ' ; 

£9) I / " Change in .Function ' 
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RELATIONSHIP BETWEEN 
PAREKT CHANGE AND 
CHILD CHANGE tfp 



.The authors state that • "the purpose of this measure is 'to 
determine whether mothers are able tc support tLeii children's 
goal-directed behavior rather than instruct them. in a parti- 
cular task. 11 It is also based on belief 'that mothers 1 behavior 
^and children's* performance are reciprocal continuously 
. engaged in a process of mutual initiation and response. 



FORMAT FOR 
PRESENTATION OF 
RESULTS 



The MPST was originally developed for* 3. follow-up study of a 
parent-infant program, and the findings were presented as an 
aggregate. They ere presently being includeo in a. monograph 
for dissemination to professional^. * * 



"The Mutual Problem-Solving Task! development , Instrument 
Pro cedures ^n&TJel Tab ility/' A. Eps t ein ,~ P . S chwaftT, ~~T7~ *"~ 
Meece, High/Scops Educational Research Foundation, February, 
1977. * a 



INFORMATION 
AVAILABLE FOR 
ADMINISTRATION 
AND USE 



TECHNICAL QUALITY: 

S TANDAJJD I Z AT I ON 
RELIABILITY AND 
VALIDITY 



Reliability : Interob^erver reliability was computed -using 
Cartwright's (1.956) ''alpha, averaging 93.0% in ceding mothers 1 
behavior and 19.5%. in. coding children's behavior. The avej^ge 
across all categories combined was 92.4%. 

Validity: * There has 'been no other technical work to date. 
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The authors c inter dec! to make the instrument as undversa] as 
possible. For instance, the recipes used in the MpST are illus- 
trated and color-coded so that the motors , 'some of whom can- 
not resd, as well as tie children who have difficulty reading, 
crai still follow the recipe without having* to ask the v observer 
to read it £o? them. A choice of two reofpes is offered, and 
all the necessary -ingredients and utensils are provided to 
insure standardization. 

• 


* 


I CULTURAL ' 

r CONSIDERATIONS 




1 POTENTIAL 
1 USES 


Although the MPST was originally developed foT a longitudinal 
evaluation of mothers and first graders who had been in a 
parent-infant prcgram, it may^also be used for evaluation with 
parents, needs assessment, or Aching and training activities. 
The authors believe that its complexity will permit numerous 
kinds of data analyses to be performed. Some possibilities 
include: comparing groups on the frequency of their behavior 
in various categories and their -frequencies of different 
responses to interview question?; examining patterns of initia- 
tion and responfe in mother- child interactions anc 1 perhaps de- 
veloping "typologies" of interactive styles; and studying the 
relationship between these patterns of mother-child interaction 
and measures of the child's learning. However ,* the complexity 
of the instrument* and its scoring procedures may also limit 
its usefuln^s. The developers^uggest simplifying the instru- 
ment and adapting it to users' needs, for instance by select- * 
ing certain aspects of the coding categories. 

«. 


9 

1 




Related Reseaxch \ 




REFERENCES 


i 

, -Epstein, Arm S. S Evan?, Judith, "Parent -Child Interaction^ 
Children's Learning," in The High/Scope Report, No. 
4, 1979, pp. 39-44. 




/ 


- .Epstein, Ann S., Schwartz, Parji, § Meece, Juftith, "The Mutual 
Problem-Solving Task: Development, Instrument Procedures 
£ Reliability," High/Scope Educational Research Foundation, 
Ypsilanti, Michigan, February, 1-977. ^ 






Reviews . 






No published reviews available to date ' , 

- * 1 
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/ 


High/Scope has developed several other mea .s of assessing ; v 
patent education that may be of potential interest. These 

include : , < - 

j 


1 

4 


CCMN2NTS 

4 

♦ 

3 


High/Scope Parent-Child Irft eraction* Checklist end 
Ratings (for children 0-2); Infant Education ^ 
Interview • / 


a 


<* 
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TITLE 



Parent -As A Readier Inventory " (PAAT) and 
Parent, As a Teacher Profile 



AUTHOR 



Robert D. Strom and Heleyi B. Slaughter 



DISTRIBUTION SOURCE 



Department of Education 
Arizona State University 
Tempe, Arizona 85281 t 



DATE OF DEYELOP>ENT 



Form A - 1972; revised for Form B - 1974 



COPYRIGHT DATES 



Material not copyrighted 



MATERIALS i\D COSTS 



Parent *As a Teacher Inventory ) 
Parent As a Teacher Profile ) 



Both available for 
research without charge 



PURPOSE 



/to measure child-rearing expectations and| the impact of paren 
education upon parent-child interaction variables 

Intended £s means for assessing parental strengths and 
needs in rearing preschool children ^ * 



WHO IS EVALUATED 
(Child or Parent) 



Parent 



/ 



SPECIAL FEATURES OF 
TARGET POPULATION 



FORMAT 



HOK ADMINISTERED 
(Including Hone) 



y") ADMIN IST5F 



ERJC 



The instrument was originally develc^d for use in a 'Title 
I program that enrolled a hLghxgropo^ion' of children of 
Mexic^fc-American and Native/ American heritage. 



4& 

The instrument is an attirude scale of items in v:hich 
individual parents o£^presihoolers or primary students des 
cribe their feelings attest, aspects of the parent-child ijiter 

artiyp qyctp.m, their criteria qf-judgefflenf fn^ asses&i&g- 



child behavior aiyl their value preferences 0 and\f rust rations « 
concerning child behavior. * \ . V 



The test, can be. administered In groups or ^divtdually. * 



Interviewer or self-administered 



9t; 



/TRAINING' 
NECESSARY FOR 
•ADMINISTRATION 



TIKE TO ADMINISTER 



■ — 

For self-administration, no training is needed. The instxu- 
ment was designed to be easily read and understood. • • 

t ' 

Administration by an interviewer usually relies on a program 
staff member -who would be sensitive to-parents* comments. 



15 to 30 minutes depending on method of administration 



CONTEST: 



SUBTESTS 



Parents are asked* about their responses to a wide variety of 
specific interactions with their child. ,The Accompanying 
■Profile divides the responses into 5 areas of parent 
curriculum with 10 items each: (1) parental acceptance of 
child's creative development; (2) frustration about child- 
rearing; (3) parent feelings about control and discipline; 
(4) understanding of children's , play and its influence on 
child development; (55 parental , self -confidence as a teacher. 
In sum, the PAAT explores what parents expect Of their child 
and how they perceive themselves as teachers. • > 



4 



GOALS. FOR, KHiq 
INSTRUMENT IS 
APPROPRIATE ' , 



CChec.k Where 
Applicable) 



-ERIC 



>Focus Toward Child: 



Cl) ZJL/ Change in Knowledge 
t 2 ) JLU Change in Attitude < 

C3) fW Chang e^Jh Function 
— % 

f ... 
"Focus Toward Schopl Services and Personnel: 

I I Change in Knowledge 

LS)„ I I ' Change in Attitude % 



; (6) / / Change in Function 



■ Focus Toward Personal Needs of -Parents as Adults: 

f 



(7) FTJ ' Change in Knowledge 

,± '(8) rV Change in Attitude^ 

Cft) /' x / Change in Function 

\ • " . ; 97 
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RHIATIONSHIP BETWEEN 
PAPIST CRINGE AND 
CHILD CHANGE 



/The Instrument* was developed from an* extensive search of the 
literature regarding aspects of a f parent ! s attitudes and be- 
havior that k influence chilcf development . Because these 
variables are seen as inter-related, the PAAT focuses on 
parent-child interaction as a system rather than upon either 
.parents or children as separate agents. ^ 



rCPyJv? FOR 
??^5ZNTATI0N OF' 
RES'JLTS 



Each i?em has four possible answers which are assigned a 
numerical value £f 4, 3, 2, or.l: strong yes,*yes, no, 
strong no. A total numerical score is obtained^by summing 
the values of all 50 items. A numerical score can also be 
derived for each of- the five subsets. The authors feel that 
information provided by the latter approach is more readily 
used by parents. „ " 



IN70R>ATI0X , " 
AVAILABLE FOPf 
ADMINISTRATION* 
ANT USE * ^ 



See "Administration, and Scoring," in Strom, R.D. and H.B. 
Slaughter, The Development of the PAAT Inventory , 1976, pp. 4 
15-17. The PAAT Profile is intended to accompany the Inven- 
tory to insure uniformity of interpretation as a guide for 
feedback to the individual parent, and as an aid to program 
planning. " £ ± 



TECHNICAL QUALITY: 

STANDARDIZATION 
'pJELIABILITY AND 
VALIDITY- 



The PAAT Inventory has been .field-tested in a number of ESEA 
Title I projects in the Southwest. It" is one of few 7 instru- 
ments which have received some systematic attention to 
quality ' control. - r * 

Reliability * Reliability of the instrument appears fairly 
high, with several studies yielding reliability coefficients 
ranging from .76 to .83. 

Validity :, A validity measure (Johnsoj/, 1975) indicated 
60% consonance between feelings and "behavior. , 



C&L7L?vAL 
CONSIDERATIONS 



Styofe arS^Slaughter (.1976) observe that "difference's in child 
rearing expectations related to ethnic and 'social class member 
ship may influence the success of particular parent education 
strategies." The . instrument provides useful information fot 
assessing and specifying the effect of cultural, socioeconomic 
status, ethnic, and sex role variables upon child-rearipg 
beliefs *and practices. *PAAT has been translated into French, 
Spanish, Nivajo, Hopi, Italian, and Gjkeek versions. 
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POTENTIAL 
USES 
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1 " 

The authors believe that ^data from the PAAT identify parents 1 
teaching strengths and needs in a form -that educators cap use 
for guidance and curriculum- planning. It has also jxroved 
useful as a me^gure of changes in the abilities and attitudes 
of parents wjiich result <from training programs. In the Parent 
and' Child Education Project (P'ACE) in Tucson/ the PAAT was \ 
used in conjunction with Caldwell ? s^Preschool Inventory ajid a 
questionnaire for parents' evaluation of the program. 



r 



L 



REFERENCES 
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tation. Arizona State University, Tempe, 1575. 
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TITLE 



Parental. Attitude Checklist 



AUTHOR 



\ 

R.D. Boyd and K.A. Stauber 



DISTRI'BUTION'SOURCE 



Cooperative Educational Service Agency 12 
412 E. Slifer St. , Box 56^ - 
Portage, Wisconsin 53901 



\ 



DATE OF DEVELOPMENT 



1977 



COPYRIGHT DATES 



Ma'teria^ not copyrighted 



MATERIALS AND COSTS 



Material available without charge 



PURPOSE . 



To assess parent attitudes an4 knowledge about teaching 
and child management techniq^e^ < 



WHO IS EVALUATED ' 
(Child or Parent) 



Parent 



SPECIAL FEATURES OF 
TARGET POPULATION 



The instrument was 'developed, for use .by home teachersNyi an 
individualized'program for families^ with a preschool handi- 
capped child after a v ^ literature search revealed tj*at no 
appropriate instrument Vas available. 



FORMAT 



Parents rate their attitudes and behavioral reactibrfs to 21 
specific teaching and child management situations along a 
5-point scale ranging from "rfever" to ^Tways." 



Self-explanatory form to be administered on a jpre-ypost-test 
bStsis ,v J '' 



HOW ADMINISTERED 
(Including Home) 



WHO ADMINISTERS 

eric 



-Self-administered 



TRAINING 
NECESSARY FOR 
ADMINTSTRAT ION 



None. In the original research, the checklist was 
administered by' a research assistant. . 



TOME TO ADMINISTER 



15 minutes 



CONTENT: 



SUBTESTS 



The checklist measures parents* knowledge* of/participati'on in 
child management techniques and teaching. More important 
dimensions include rein'forcement , correction and use of 
i instructional aids. • Parents-are asked about their role as 
.teacher, their self-confidence, and theix attitudes, toward 
-child discipline. . ' 1 



G0AI,S FOR %HICt( 
INSTRUMENT IS 
APPROPRIATE 



\ (Check- Where 
Applicable) 



Focus' Toward Child: ^ 

• ' 1 •' 

CI) / X / Change in Knowledge 

C2) fTJ Change in Attitude *• 

' C5) / X / Change in Function 

Focus Toward Scfiool Services and Personnel: / 
t4) / / Change in Knowledge . 
£5) y / Change in Attitude k ^ . . 

(6) / / .Change in Function 

. ; 

Focus .Toward Personal Needs of Parents as Adults: 

(7) / / Change in Knowledge 

f 81 / X/ "Change in- Attitude - . * . 

^q) I / Change in Functiqn ' ' - 

— fOi ■. ; 
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RELATIONSHIP BETWEEN 
PARENT CHANGE AND 
CHILD CHANGE 



The authors maintain of this and the PareiitaJL Behavior In- 
ventory (p. 104) that: "While' the ultimate effects must be 
demonstrable gains in child response, the staying power and 
preventive capability of early intervention programs hinges 
upon the acquisition and generalization of appropriate 
parental teaching and child management behaviors. , If parents 
acquire more appropriate teaching and child management be- ' 
haviors, and these are ..enduring change v in their r^ertoire, 
then perhaps we will begin to approximate preventative pro- * 
gramming." Emphasis is placed upon assessing .parents-child t 
interactions in terms of an Antecedent-Behavior-Consequent . 
Model, where parental antecedent and consequent events s.erve 
to "evoke and maintain child tyehavior. 



FORMAT FOR- . 
PRESENTATION OF 
RESULTS 



Ratings yielded b*y the 
of the parentis strenjg 
specific nespons.es th 
■ \ 




list offer representative knowledge 
and wetnesses, an4 help yidi^ate ' 
an be^xargeted' f;or change. 



INFORMATION 
AVAILABLE FOR 
ADMINISTRATION 
AND. USE 



See "Guidelines for Administration" available from Boy^ and* 
Stauber. 



TECHNICAL QUALITY: 

STANDARDIZATION 
RELIABILITY" AND 
VALIDITY ; 



Reliability : 

To assess int er-rater reliability, a random sample of know- 
ledge measures ^as independently scored by both the research 
assistant and a program staff school psychologist. The 
Pearson produce-moment statistic yielded an, inter-rater i 
coef f icient ^of .95 on 'pre-test and .96 on posjtf-test-. Intra- 
rater reliability on a sample of questionnaires was fouhd to 
be"T92 on pre-test and .98 on post-test. 

Validity: * 



:RLC 



There has bedn no other technical work to date. 



. • • ■; 



♦ v. 



\ 

CULTURAL- 
CONSIDERATIONS 
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Cu-ltural issues do not seem to have been important in the 
development ai^d implementation of the instrument.' 

4b • - 



potevTia; 

USES 



Data provided by the checklist offer a basis for examining 
group differences as a result of different iijterventicms . * 
However, the developers .now believe that the instrument is 
not very discriminative, > 



'A 



REFERENCES 



Related Research 



*£oyd, R.D. artd Stauber, K.A., Parent Behavior Inventory : 
Portage Parent Program, , -CESA 12, Portage, WI, April 1977, 

Boyd, R.D. , Stauher; K.A., and Bluma, S.M. , Instructor 1 s, , 
Manual: Portage Parent Program , CESA 12, Portage, WI r 
Npril 1977T N ' 

Shea»eryM.S, arid Sheerer, D: E . v , "The Portage Project.: A 
Model for Early Childhood Education," Exceptional Children , 
1972, 39, 210-217. - / 

Johrtson, C.A. and Katz^ &.C., "Usiijg Parents J as Change Agents 
for Their Childi^n: A Review." Journal of Child Psychology 
and Psychiatry , 1973, 14/ 181-200. 



Reviews : 



\ 



No published reviews available' to date 



COMMENTS 



Boyd and Stauber *have also developed the Parental Behavior 
Inventory, , , , • • 
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TITLE . 



Parental Behavior Inventory 

/ 



AUTHOR 



R.D. Boyd and K.A. Stauber 



DISTRIBUTION SOURCE 



Cooperative Educational Service Agency 12 
412 E. Slifer St. , Box 564 
Portage, Wisconsin 53901 



DATE OF DEVELOPMENT 



1977 



COPYRIGHT DATES 



1977 



MATERIALS AND COSTS 



Five copies of instructional materials (parent readings) and 
five inventories @ $18.00, Instructor's set of |t instruc- 
|or's manual, _1 book of parent readings*, • and 1 inventory 6^ 



PURPOSE 



To help structure the home teacher's assessment of* the 
parent's skills in both teaching and child management 

Offers a systematic procedure to account for the, amount or 
type of teaching and management skills acquired by parents 



WHO IS EVALUATED. 
(Child or Parent) 



Parent, in role as child's primary teacher 



SPECIAL FEATURES OF 
TARGET' POPULATION 



The instrument w£s developed for use by hom£ teachers in an* 
individualized program for 'families with a preschool* 
handit\apped_child ^ / 



FORMAT 



The instrument consists of an 80-item checklist. Home * 
teachers olasetve and informally rate parental performance 
along an ari^y of teaching and management behavior. 



HOK .ADMINISTERED 
(Including Home) 



Home teacher codes .parent's behavior in home 



W ADMINISTERS. 

ER1C_1 



Home teacher 

— ^ — 35- 



C 10, 



4 



TRAINING 
NECESSARY FOR ' 
ADMINISTRATION \ 



•103- ' - . ' ^ 

■ i — ( ■ 

'he instrument ^an be administered : by professionals or para- 
:rofessionals if adequate training is provided. 'The developers 
used 2-1Y2 days of pre-service and ir.service' training-, which, in- 
cluded the use of videotapes for practice in coding behavior. 



TINE TO ADMINISTER 



About 10 : min\ites. The administration time varies, depending on 
the particular behavior the observer' chooses to' code. 

_2_ 



CONTENT : 



-SUBTESTS 



The Inventory measures knowledge of and participation in child 
management techniques , and teaching. The home teacher codes the 
frequency of a variety of teaching behavior used bythe par- 
ent: .materials used; Use of reinforcement "and punisMvent ; 
planning,-. giving. directions*,, and recording, progress. 



GOALS FOR WHICH 
INSTRUMENT IS 
APPROPRIATE ^ 

(Check .Where 
Applicable) 



ERLC 



Focus Toward Child: n 
O) ZX7 Ch an g e in. Knowledge 
C 2 ) ZX7 Gh an g e in AttitudS ' ^ 

' iZ) '/T7 -Change in Function . , 

i * 

s 

Focus Toward School Services and Personnel: , 
C4) /~ 7^Change in fciowledge * , 

{S). / A Change in Attitude 
£6) / / Change in- Function 

Focus Toward Personal Needs .of Parents as Adults^ 
' C7) V 7 Change. in Knowledge 
(8) y 7 Change in Attitude 
£9) fjj ^Change in Functi 



on 



T05 



t 
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RELAT10NSHIP BETWEEN 
PARENT CHANGE AND 
CHI-LD CHANGE 



FORMAT FOR 
PRESENTATION" OF 
RESULTS ■ 



See 'comments on the Parental Attitude Checklist by trie 
same authors (pg. 100). 



Ratings yielded by the Inventory offer representative knowledge 
of the parents' strengths and' weaknesses , and help indicate 
specific responses that can be targeted fox change. The devel- 
opers recommend that the observer select a particular behavior 
as the target for change, and compare frequency counts of the 
behavior pre- and ppst-intervention in order to docunent any 
changes. 



INFORMATION 
AVAILABLE FOR 
ADMINISTRATION 
AND USE 



Instructor's manual 
Behavior code definitions 



technical quality: 

standardization 
reliability ant) 
a'alidity 



Reliability: .A trained observer accompanied home teachers on 
,a sample of home visits to determine the accuracy of home 
teachers independently recording parent behavior. 



Validitv; There has been no other technical work to date. 



V 



-ERIC. 



Because the Inventory was developed as an observation tool, . 
not 511 the items are always scored. Hence, it has undergone 
no standardization work. 



c 
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1 • 

CULTURAL 
CSNSIDERATIONS- 



L 



POTENTIAL 
USES 



Cultural issues dtf not seem to \\ave be^en important in th^ 
development and implementation of the instrument. 



^lUiiie tne actual extent 
popular, as the develop: 
of the materials have, b; 
tory offer a' basis for 
fnoSe*! .with systematic p; 
that tiiis approach ~ i: 
as an interactive syste; 
aimed at disadvantaged 



of use is not known, it appears to be 
♦rs- report that several thousand copies 
;en sold. Data provided by the Inve*n- 
:ombining a prescriptive- teaching^ 
irent training. The authors believe * 
•tervention with both parent an<i child 
3 holds great promise for programs 
:v child % -abuse populations. 



REFERENCES 



Related Research 



Boyd, R.D., $ Stauber,' K. A. Parent Behavior Inventory 
■ Portage Parent Progra.ii , CESA 12, Portage; HI, Aprjl 1977. 

Bo/d, O., Stauber, K*A'., $ Bluma, S.M. ', Instructor's 
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Shearer, M.S. $ Shearer, D.E., "The Pqrtage Project: A 
Model for Early Childhood Education." Exceptional Chil T 
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Johnson, C.A., $ Kat:, R.C., "Using Parents as^ Change Agents 
for Their Children: A Review, V Journal of Chi ldS^ycho logy 
ans Psychiatry , -1S75, ^14, 181-200. , ^ 

Reviews x - 

No published reviews available to date * 



V 



COMMENTS 



Boyd and Stauber have also developed the Parental Attitude 
Checklist. 
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